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Abstract 

The present paper continues the study of infinite dimensional calcu- 
lus via regularization, started by C. Di Girolami and the second named 
author, introducing the notion of weak Dirichlet process in this context. 
Such a process X, taking values in a Hilbert space H , is the sum of a local 
martingale and a suitable orthogonal process. 

The new concept is shown to be useful in several contexts and directions. 
On one side, the mentioned decomposition appears to be a substitute of 
an Ito's type formula applied to /(t, X(t)) where / : [0, T] x H — > R is a 
C 0,1 function and, on the other side, the idea of weak Dirichlet process fits 
the widely used notion of mild solution for stochastic PDE. As a specific 
application, we provide a verification theorem for stochastic optimal con- 
trol problems whose state equation is an infinite dimensional stochastic 
evolution equation. 
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1 Introduction 



Stochastic calculus constitutes one of the basic tools for stochastic optimal con- 
trol theory; in particular the classical Ito formula allows to relate the solution 
of the problem in closed loop form with the (smooth enough) solutions of the 
related Hamilton-Jacobi-Bellman (HJB) equation via some suitable verification 
theorems. 

For the finite dimensional systems the literature presents quite precise and 
general results, see e.g. [22, 56J. If the system is infinite dimensional, for instance 
if it is driven by a stochastic partial differential (SPDEs) or a stochastic delay 
differential equation, the situation is more complex especially when the value 
function of the problem is not regular enough. 

This paper contributes to the subject providing an efficient (infinite dimen- 
sional) stochastic calculus which fits the structure of a mild solution of a SPDE 
and allows to prove a verification theorem for a class of stochastic optimal con- 
trol problems with non-regular value function, refining previous results. 

The contributions of the paper can be ascribed to the following three "labels": 
infinite dimensional stochastic calculus, SPDEs and dynamic programming. In 
the next subsection we describe the state of the art, while in the following we 
will concentrate on the new results. 



State of the art 

Stochastic calculus. 

Stochastic calculus via regularization for real processes was initiated in |48| 
and [49]. It is an efficient calculus for non-semimartingales whose related liter- 
ature is surveyed in |52| . 

Given a locally bounded real process Y and a continuous real process X, 
the forward integral of Y with respect to X and the covariation are defined 
as follows. Suppose that for every t <E [0, T], the limit I(t) [resp. C(t)] in 
probability exists: 



I(t) 



(i) 



C { t): = lim f (X(r + e)-X(r))(Y(r + e)-Y(r))^ 



e->0+ 







If the random function I (resp. C) admits a continuous version, that will be 
denoted with J Q Yd~X (resp. [X, Y]). It is the forward integral of Y with 
respect to X (resp. the covariation of X and Y). If X is a real continuous 
semimartingale and Y is a cadlag process which is progressively measurable 
(resp. a semimartingale), the integral j Q Yd~X (resp. the covariation [X, Y]) 
is the same as the classical Ito's integral (resp. covariation). 
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The definition of [X, Y] given above is slightly more general (weak) than in 
[52J. There the authors supposed that the convergence in ([1]) holds in the ucp 
(uniformly convergence in probability) topology. In this work we use the weak 
definition for the real case, i.e. when both X and Y are real, and the strong 
definition, via ucp convergence, when either X or Y is not one-dimensional. 
When X = Y the two definitions are equivalent taking into account Lemma 2.1 



Real processes X for which [X, X] exists are called finite quadratic variation 
processes. A rich class of finite quadratic variation processes is provided by 
Dirichlet processes. Let (^t,t 6 [0, T]) be a fixed filtration. A real process X is 
said to be Dirichlet (or Follmer- Dirichlet) if it is the sum of a local martingale 
M and a zero quadratic variation process A, i.e. such that [A, A] = 0. Those 
processes were defined by H. Follmer [23] using limits of discrete sums. A 
significant generalization, due to |21[ 133) , is the notion of weak Dirichlet process, 
extended to the case of jump processes in [5] . 

Definition 1.1. A real process X: [s,T] x Q — > K is called weak Dirichlet 
process if it can be written as 



(i) M is an local martingale, 

(ii) A is a process such that [A,N] — for every continuous local martingale 
N and A(0) = 0. 

Obviously a semimartingale is a weak Dirichlet process. In Remark 3.5 of 
[33], appears the following important statement. 

Proposition 1.2. The decomposition described in Definition \l.l\ is unique. 

Elements of calculus via regularization were extended to Banach space valued 
processes in a series of papers, see e.g. [161 IT51 H^l I17j . 

We start introducing two classical notions of stochastic calculus in Banach 
spaces, which appear in [42 and [19 : the scalar and tensor quadratic variations. 
We propose here a regularization approach, even though, originally appeared in 
a discretization framework. The two monographs above use the term real instead 
of scalar, we have decided to change it to avoid confusion with the quadratic 
variation of real processes. 

Definition 1.3. Consider a separable Banach spaces B. We say that a process 
X: [s, T] x $1 — > B admits a scalar quadratic variation if, for any t G [s,T], the 
limit, for e \ of 



exists in probability and it admits a continuous version. The limit process is 
called scalar quadratic variation of X and it is denoted with [X,X] R . 



of [S5]. 



X = M + A, 



(2) 



where 
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Proposition 1.4. Let B be a separable Banach space. A continuous B-valued 
process with bounded variation admits a zero scalar quadratic variation. In 
particular, a process X of the type X(t) = J s b(s)ds, where b is an B-valued 
strong measurable process has a zero scalar quadratic variation. 

Proof. The proof is very similar to the one related to the case when B = R, 
which was the object of Proposition 1 7) b), see □ 

Remark 1.5. The definition above is equivalent to the one contained in 
In fact, previous convergence in probability implies the ucp convergence, since 
the e- approximation processes are increasing and so Lemma 3.1 in J5Tj can be 
applied. 

From [T4J we borrow the following definition. 

Definition 1.6. Consider two separable Banach spaces B\ and £?2- Suppose 
that either B\ or B2 is different from R. Let X: [s, T] x SI — > B\ and Y: [s, T] x 
Q — > B-2 be two strongly measurable processes. We say that (X, Y) admits a 
tensor covariation if the limit, for e \ of the Bi®^B2-valued processes 

[X)Y] ®,e . = f (X(r + 6)-X(r))(8)(Y(r + 6)-Y(r)) ^ 



exists ucp. The limit process is called tensor covariation of (X, Y) and is denoted 
with [X, Y]®. The tensor covariation [X, X]® is called tensor quadratic variation 
of X and denoted with [X] ® . 



The concepts of scalar and tensor quadratic variation are however too strong 
for the applications: indeed several interesting examples of Banach (or even 
Hilbert) valued processes have no tensor quadratic variation. A Banach space 
valued example is the C([— r, 0])-valued process X defined as the frame (or win- 
dow) of a standard Brownian motion W: X(i)(a;) :— W(t + x), x e [— r, 0]. It 
is neither a semimartingale, nor a process with scalar quadratic variation pro- 
cess, see considerations after Remarks 1.9 and Proposition 4.5 of [14J. A second 
(more general) example among C([— r, 0])-valued processes is given by the win- 
dows of a real Dirichlet (resp. weak Dirichlet) process, see the consideration 
below Definition 1.8 in [T7]. A third example that constitutes a main motiva- 
tion for the present paper is given by mild solutions of classical stochastic PDEs 
of evolution type: they have no scalar quadratic variation even if driven by a 
one-dimensional Brownian motion. 

The idea of Di Girolami and Russo was to introduce a suitable space \ 
continuously embedded into the dual of the projective tensor space Bi®„B2, 
called Chi-subspace. \ is a characteristics of their notion of quadratic variation, 
recalled in Section 14.11 when Bi are Hilbert spaces. When \ is the full space 
(Bi<Ei w B2)* the x-quadratic variation is called global quadratic variation. Fol- 
lowing the approach of Di Girolami and Russo, see for instance Definition 3.4 of 
|17j . we make use of a the notion of x-covariation [X, Y] x when \ Q (Hi® n H2)* 
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for two processes X and Y with values respectively in separable Hilbert spaces 
Hi and Hi. That notion is recalled in Definition 14.41 

[15J introduces a (real valued) forward integral, denoted by 
B , in the case when the integrator X takes values in 
a Banach space B and the integrand Y is B*-valued. This appears as a natural 
generalization of the first line of {jTJ) . That notion is generalized in Definition 
13. II for operator- valued integrands; in that case, this produces a Hilbert valued 
forward integral. 

The Ito formula for processes X having a x-quadratic variation is given in 
Theorem 5.2 of [14J. Let F : [0,T] x B -> R or class C 1 - 2 such that d 2 xx F G 
C([0, T] x 5; x). Then, for every t G [0, T], 

F(t J X(*))=.F(0,X(0)) + / d s F( Sl X( s ))ds+ f B .(B x F{a,X(a)),drX{a)) B 

Jo Jo 

+ ^ t x (C^,X(.s)),d[£i] s ) x , a.s. (3) 

We will introduce the notation [X, X] in Section |31 

Stochastic partial differential equations (SPDEs) . 

A stochastic PDE is generally a deterministic PDE perturbed by a Gaussian 
noise involving an infinite dimensional Wiener process Wq as a multiplicative 
factor and/or an additive term. Many stochastic partial differential equations 
can be rewritten as evolution equations in Hilbert spaces. Consequently many 
related optimal control problems can be reformulated in the abstract infinite 
dimensional formulation. Among the equations, we remind heat and parabolic 
equations (even with boundary controls or noise), wave, reaction-diffusion, and 
(with different formalism) Burgers, Navier-Stokes and Duncan-Mortensen-Zakai 
equations, even though not all of them can be represented in the abstract frame- 
work we use in this work. We remark that functional stochastic differential 
equations, as delay or neutral differential equations, can be included in the 
same formalism. First elements and references can be found for example in 
Part III of the book [TT] . The abstract formulation of the stochastic evolution 
equation introduced in Section [5] is characterized by an abstract generator of a 
Co-semigroup A and Lipschitz coefficients b and a. It appears as 

dX(t) = (AX(t) +b(t,X(t))) dt + a{t,X(t))dW Q (t) 

( 4 ) 

X(0) = x, 

where W is a Q- Wiener process with respect to some covariance operator Q. 

This describes in fact a significant range of systems modeling phenomena 
arising in very different fields (physics, economics, physiology, population growth 
and migration...). 

There are several different possible ways to define the solution of an SPDE: 
strong solutions (see e.g. [10] Section 6.1), variational solutions (see e.g. [46]), 
martingale solutions (see |44)V.. 
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We make use of the notion of mild solution (see [TU] Chapter 7 or [55] Chapter 
3) where the solution of the SPDE (J4]) is defined (using, formally, a "variations 
of parameters" arguments) as the solution of the integral equation 

X(t) = e^ A x + J e^ A b{r,X(r))dr + e {t - r)A a(r, X(r)) dW Q (r). 
This concept is widely used in the literature. 

Optimal control: dynamic programming and verification theorems. 

As in the study of finite-dimensional stochastic (and non-stochastic) optimal 
control problem, the dynamic programming approach connects the study of the 
the minimization problem with the analysis of the related Hamilton-Jacobi- 
Bcllman (HJB) equation: given a solution of the HJB and a certain number of 
hypotheses, the optimal control can be found in feedback form (i.e. as a function 
of the state) through a so called verification theorem. 

When the state equation of the optimal control problem is an infinite di- 
mensional stochastic evolution equation, the related HJB is of second order and 
infinite dimensional. The verification theorem depends on the way the HJB is 
settled; the simplest procedure consists in considering the regular case where 
the solution is assumed to have all the regularity needed to give meaning to 
all the terms appearing in the HJB. For defining weaker solutions (the HJB 
does not admit a regular solution in general) in the literature there are several 
possibilities, the various approaches being classified as follows. 

Strong solutions: in this approach, first introduced in [3J, the solution is 
defined as a proper limit of solutions of regularized problems. Verification 
results in this framework are given for example in [30J and [31], see (5][6] 
for the reaction-diffusion case. 

Viscosity solutions: in this case the solution is defined using test func- 
tions that locally "touch" the candidate solution. The viscosity solution 
approach was first adapted to the second order Hamilton Jacobi equation 
in Hilbert space in [37, 38, 39] and then, for the "unbounded" case (i.e. in- 
cluding the unbounded operator A appearing in (|7ip) in |55| . As far as we 
know, differently from the finite-dimensional case there are no verification 
theorems available for the infinite-dimensional case. 

L 2 ^ approach: it was introduced in [2] [25], see also [HE]- In this case 
the value function is found in the space L^(/f), where /i is an invariant 
measure for an associated uncontrolled process. The paper [25] contains 
as well an excellent literature survey. 

Backward approach: it can be applied when the mild solution of the HJB 
can be represented using the solution of a forward-backward system and 
allows to find an optimal control in feedback form. It was introduced in 
[17] and developed in [35] [57J IM] , see [T2, 25j for other particular cases. 
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The method we use in the present work to prove the verification theorem 
does not belong to any of the previous categories even if we use a strong solution 
approach to define the solution of the HJB. In the sequel of this introduction, 
we will be more precise. 

The contributions of the work 

The novelty of the present paper arises at the three levels mentioned above: 
stochastic calculus, SPDEs and stochastic optimal control. Indeed stochastic 
optimal control for infinite dimensional problems is a motivation to complete 
the theory of calculus via regularizations. 

The stochastic calculus part starts (Sections [3]) with a natural extension 
(Definition 13. 1|) of the notion of forward integral in Hilbert spaces introduced 
in [15J and with the proof of its equivalence with the classical notion of integral 
when we integrate a predictable process w.r.t. a Q- Wiener process (Theorem 
I3.4|) and w.r.t. a general local martingale (Theorem 13. 6[) . 

In Sectional we extend the notion of Dirichlet process to infinite dimension. 
Let X be an if-valued stochastic process. According to the literature, X can 
be naturally considered to be an infinite dimensional Dirichlet process if it is 
the sum of a local martingale and a zero energy process. A zero energy process 
(with some light sophistications) X is a process such that the expectation of the 
quantity in Definition 11.31 converges to zero when e goes to zero. This happens 
for instance in |13) , over though that decomposition also appears in |40| Chapter 
VI Theorem 2.5, for processes X associated with an infinite-dimensional Dirichlet 
form. 

Extending Follmer's notion of Dirichlet process to infinite dimension, a pro- 
cess X taking values in a Hilbert space H , could be called Dirichlet if it is the 
sum of a local martingale M plus a process A having a zero scalar quadratic 
variation. However that natural notion is not suitable for an efficient stochastic 
calculus for SPDEs. 

Similarly to the notion of ^-finite quadratic variation process we introduce 
the notion of x-Dirichlet process as the sum of a local martingale M and a 
process A having a zero %-quadratic variation. 

A completely new notion in the present paper is the one of Hilbert valued 
v-weak Dirichlet process which is again related to a Chi-subspace v of the dual 
projective tensor produce H® n H\ where H\ is another Hilbert space, see Defini- 
tion [4723] It is of course an extension of the notion of real- valued weak Dirichlet 
process, see Definition 11.11 We illustrate that notion in the simple case when 
Hi = M, v = z^o®-n-R = vq and vq is a Banach space continuously embedded in 
H* : a process X is called i/-weak Dirichlet process if it is the sum of a local mar- 
tingale M and a process A such that [A, N] Vo = for every real local martingale 
N . This happens e.g. under the following assumptions: 

(i) ~ J Q T |A(r + e) — A(r)|„* \N(r + e) — N(r) \ dr is bounded in probability for 
all the small e. 
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(ii) For all h e vo, lim e _ >0 + |jj Vo (A(r + e) - A(r), h) u , {N(r + e) - 
7V(r))dr = 0, Vi G [0,T]. 

At the level of pure stochastic calculus, the most important result, is The- 
orem 2321 It generalizes to the Hilbert values framework, Proposition 3.10 of 
[3"5] which states that given / : [0, T] x K R of class C - 1 and X weak Dirich- 
let process with finite quadratic variation then Y(t) = fit, X{t)) is a real weak 
Dirichlet process. This result is a Fukushima decomposition result in the spirit 
of Doob-Meyer. It can also be seen as a substitution-tool of Ito's formula if / is 
not smooth. Besides Theorem I4.32( an interesting general Ito's formula in the 
application to mild solutions of SPDEs is Theorem l5.4l The stochastic calculus 
theory developed in Sections [3J and 0] allows to prove that a mild solution of an 
SPDE of type (|4]) is a ^-Dirichlet process and a z/-weak-Dirichlet process; this is 
done in Corollary [5T3J Observe that many notions and results in this work may 
be written in a Banach framework. We decided however to keep the Hilbert 
formulation in order to simplify the readability. 

As far as stochastic control is concerned, the main issue is the verification 
result stated in Theorem l6.10l As we said, the method we used does not belong 
to any of the described families even if we define the solution of the HJB in line 
with a strong solution approach. Since the solution v : [0, T] x H — > R of the 
HJB equation is only of class C ' 1 (with derivative in C(H,D(A*))), we cannot 
apply a Ito formula of class C 1 ' 2 . The substitute of such a formula is given in 
Theorem 16.71 which is based on the uniqueness character of the decomposition 
of the real weak Dirichlet process «(t,X(t)), where X is a solution of the state 
equation X. The fact that v(t, X(t)) is weak Dirichlet follows by Theorem 14.321 
because X is a i/-weak Dirichlet process for some suitable space v. This is the 
first work that employs this method in infinite dimensions. A similar approach 
was used to deal with the finite dimensional case in [35] but of course in the 
infinite-dimensional case the situation is much more complicated since the state 
equation is not a semimartingale and so it indeed requires the introduction of 
the concept of v-weak Dirichlet process. 

For the reasons listed below, Theorem 16. 101 is more general than the results 
obtained with the the classical strong solutions approach, see e.g. [301 [3T], and, 
in a context slightly different than ours, [5] [5|. 

(1) The state equation is more general. 

(a) In equation (f6"6"]) the coefficient a depends on time and on the state 
while in classical strong solutions literature, it is constant and equal to 
identity. 

(b) In classical strong solutions contributions, the coefficient b appearing 
in equation (|66p is of the particular form 6(t,X, a) — &i(X) + a so it 
"separates" the control and the state parts. 

(2) We only need the Hamiltonian to be well-defined and continuous without 
any particular differentiability, as in the classical strong solutions litera- 
ture. 



(3) We use a milder definition of solution than in [3UJ [31]; indeed we work 
with a bigger set of approximating functions: in particular (a), our do- 
main £>(«2o) ; does not require the functions and their derivatives to be be 
uniformly bounded; (b), the convergence of the derivatives d x v n — > d x v in 
(16. 6p is not necessary and it is replaced by the weaker condition ([75)1 . 

However, we have to pay a price: we assume that the gradient of the solution 
of the HJB d x v, is continuous from H to D(A*), instead of simply continuous 
from H to H . 

In comparison to the strong solutions approach, the L 2 ^ method used in [29"] 
allows weaker assumptions on the data and enlarges the range of possible appli- 
cations. However, the authors still require a to be the identity, the Hamiltonian 
to be Lipschitz and the coefficient b to be in a "separated" form as in (l)(b) 
above. In the case treated by [2J, the terms containing the control in the state 
variable is more general but the author assumes that A and Q have the same 
eigenvectors. So, in both cases, the assumptions on the state equation are for 
several aspects more demanding than ours. 

The backward approach used e.g. in [251 [23 H3] can treat degenerate cases 
in which the transition semigroup has no smoothing properties. Still, in the 
verification results proved in this context, the Hamiltonian has to be differen- 
tiable, the dependence on the control in the state equation is assumed to be 
linear and its coefficient needs to have a precise relation with er(t, X(i)). All 
those hypotheses are stronger than ours. 

One important feature of Theorem l6.10l is that that we do not need to assume 
any hypothesis to ensure the integrability of the target. This is due to the fact 
that we apply the expectation operator only at the last moment. 

The scheme of the work is the following. After some preliminaries in Sec- 
tion [2J in Section [3] we introduce the definition of forward integral in Hilbert 
spaces and we discuss the relation with the Da Prato-Zabczyk integral. Section 
[31 devoted to stochastic calculus, is the core of the paper: we introduce the 
concepts of %-Dirichlet processes, ^-weak-Dirichlet processes and we study their 
general properties. In Section [SJ the developed theory is applied to the case of 
mild solutions of SPDEs, while Section [5] contains the application to stochastic 
optimal control problems in Hilbert spaces. 

2 Preliminaries and notations 

Consider two separable Hilbert spaces, H and U. Denote | • | and (•, •) [resp. | • \jj 
and (•, ^jj] the norm and the inner product on H [resp. U]. Denote by £([/, H) 
the set of all linear bounded operators from U to H. C(U,H), equipped with 
the operator norm 1 1 T" 1 1 ^(t/,^) : — su P«gc/ ^u\" ' * s a Banach space. If H = U 
we denote C(U,H) simply by C(U). Recall that, if U and H are both infinite 
dimensional, then C(U, H) is not a separable space. 
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Fix T > and s € [0, T). Let (17, JF, P) be a complete probability space and 
{^t s }t> s a filtration on (17, ^,P) satisfying the usual conditions. Each time 
we use expressions as "adapted", "predictable" etc... we will always mean "with 
respect to the filtration {^ t s } t>s ". Denote with 8? the predictable cr-field on 
[s,T]xQ. 

Given a subset 17 e & we denote with 1^ : 17 — > {0,1} the characteristic 
function of the set 17, i.e. I^ 1 ^) = 1 if an d only if u 6 17. 

Notation 2.1. TTie blackboard bold letters X, Y, M... are used for Hilbert- 
valued (or Banach-valued) processes, while notations X (or Y, M...) are re- 
served for real valued processes. 

The dependence of a process on the variable co 6 17 is emphasized only if 
needed by the context. When we say that a process is continuous (resp. left 
continuous, right continuous, cadlag, caglad ...) we mean that almost all paths 
are continuous (resp. left continuous, right continuous, cadlag, caglad...). 

Let B be a Banach space. The Borel cr-field on B is denoted with £$(B). 
By default we assume that all the processes X: [s, T] x 17 — y B are measurable 
functions with respect to the product c-algebra 3§([s,T]) x & with values in 
{B,@{B)). Let <S be a sub-cr-field of &{[s,T}) ® A process X : ([s,T] x 
17, Sf) — > B is said to be strongly (Bochner) measurable if it is the limit of 
^-measurable countable-valued functions. If B is separable, X measurable and 
cadlag (or caglad) then X is strongly measurable. If B is finite dimensional 
then any measurable process X is strongly measurable. We always suppose 
that all the processes X measurable on (17 x [s 7 T],V) we consider are strongly 
measurable. In that case we will also say that those processes are predictable. 

Notation 2.2. We always assume the following convention: when needed all 
the Banach space processes (or functions) indexed by [s,T] are extended setting 
X(f) = X(s) fort<s and X(t) = X(T) for t>T. 

As already emphasized in the introduction many of the concepts appearing 
in this paper could be generalized from the Hilbert space to the Banach space 
environment without major changes. In any case, to make the arguments more 
transparent, we distinguish between H and its dual H* and use the following 
convention. 

Notation 2.3. If H is a Hilbert space with every element h € H we associate 
h* E H* through Riesz Theorem. 

2.1 Reasonable norms on tensor products 

Consider two real Banach spaces B\ and Bi- Denote, for i = 1,2, with • \i 
the norm on Bi. B\® B2 stands for the algebraic tensor product i.e. the set of 
the elements of the form X)"=i x i ® Vi where Xi and yt are respectively elements 
of B\ and B^. On B\ ® Bi we identify all the expressions we need in order to 
ensure that the product ® : B\ x B 2 — >• B\ ® Bi is bilinear. 
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On B\ ® B2 we introduce the projective norm 7r defined, for all u S B\® B2, 

as 

7r(u) := inf < ^ |xi|i|yi| 2 : u = y^ j x i ®y i \ . 

{i=l i=l J 

The projective tensor product of B\ and B2, Bx®^B2, is the Banach space 
obtained as completion of B\ ® i?2 for the norm 7r, see [53] Section 2.1, or [15] 
for further details. 

For it 6 B\ ® B2 of the form u = Y^i=i x i ® Vi we define 



e(u) := sup • 



and denote with B\® t B2 the completion of -Bi <g) B2 for such a norm: it is the 
injective tensor product of B\ and B2. We remind that e(u) does not depend 
on the representation of u and that, for any u € B\ ® B2, e(u) < n(u). 
A norm a on B\ ® B2 is said to be reasonable if for any u £ B\ ® B2 , 

e(w) < a(u) < 7r(u). (5) 

We denote with B\® a B2 the completion of B\ ® £?2 w.r.t. the norm a. 
For any reasonable norm a on B\ ® B2 , for any x £ B± and y & B2 one has 
a(x<g>j/) = x|i|?/|2- See [53_ Chapter 6.1 for details. 

Lemma 2.4. Let B\ and B2 be two reflexive Banach spaces and a a reasonable 
norm on B\ (g> B?,- We denote Bi® a B 2 by B. Choose a* 6 B{ and b* G B* 2 . 
One can associate to a* (g> b* the elements i{a* ® b*) of B* acting as follows on 
a generic element u = Xj ® y% G B\ ® B2: 

n 

(i(a* ®b*),u) = E (a*,x 4 ) (b*,y % ) . 

i 

Then i{a* (8)6*) extends by continuity to the whole B and its norm in B* equals 
|o*| fl f|6lfl 5 . 

Proof. We first prove the < inequality. It follows directly by the definition of 
injective tensor norm e that 

(i(a*®6*),tt) < e(v,)\a*\ B *\b*\ B *- 

By ([3]) e is the less rough of the all reasonable tensorial norms so (i(a* ® b*), u) < 
a(u)\a*\ B * \b*\ B * and the claim is proved. 

Concerning the converse inequality, we have 

|o*|b. = sup B * (a*,4>) Bi 
k^lsi =1 
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and similarly for b* . So, chosen 5 > 0, there exist <j>i £ B\ and <f>2 £ B2 with 
\4>i\bi = 102 \b 2 = 1 and 



|o*|b ? <S+ B*(a*,<Pi) Bl , \b*\ B; <S+ B 5 (b*,cf >2 ) B2 . 
We set u :— (f>i ® (f>2- We obtain 

B * {i(a* ®b*),u) B B . {i(a* ®b*),u) B 

\i[a ®b j B * > j— j = r— — — 

Mb |</>i|biI</>2|b 2 

= b* (a*,<i>i) Bl b* (b*,(f>2) B2 

>(\a*\ B; -6)(\b*\ B .-S). (6) 

Since 5 > is arbitrarily small we finally obtain 

\i(a*®b*)\ B * > |o*|b.|6*| b .. 

This gives the second inequality and concludes the proof. □ 

Notation 2.5. When B\ = B 2 = B and x £ B we denote with x® 2 the element 
x® x £ B <g> B. 

The dual of the projective tensor product i?i(g) w J52, denoted by (Bi 8^.82)* , 
can be identified isomorphically with the linear space of bounded bilinear forms 
on B\ x B 2 denoted with B(Bi,B2). If u £ (.Bi (8^-82)* and ip u is the associated 
form in B(Bi, B2), we have 

\ U \(B 1 ^B 2 )- = SU P \ipu(a,b)\. 

|a| 1 <1,|6| 1 <1 

See for this [53] Theorem 2.9 Section 2.2, page 22 and also the discussion after 
the proof of the theorem, page 23. 

If B\ = Hi and B2 = H2 where Hi, H2 are separable Hilbert spaces, we de- 
note by £2(^1,^2) (resp. C(Hi, H2)) the Hilbert space of the Hilbert-Schmidt 
(resp. the Banach space of linear continuous) operators, from Hi to i?2- For 
more details about those operators, see [10] Appendix C. 

Suppose now that H = H\ = H2; we denote with by £i(H,H) the Banach 
space of nuclear operators, see [TU] Appendix C. The product of a map T £ 
C(H,H) with a map B £ C X {H,H) belongs to C X {H,H), see Corollary C.2 
Appendix C in [10]. If T £ Cx(H,H) we denote TrT the Trace of T: more 
particularly, if (e„) is an orthonormal basis of H we have TrT = ^2 n {Te n , e n ) B 
and that quantity does not depend on the choice of the orthonormal basis, see 
Proposition C.l Appendix C in [10] . 

Every element u £ H®^H is isometrically associated with an element T u in the 
space of nuclear operators Ci(H,H), defined, for u of the form °" ® ^ n > 

as follows: 



i=l 
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see for instance [53] Corollary 4.8 Section 4.1 page 76. 

Since T u is nuclear, in particular (see Appendix C of [10]), there exist a 
sequence of real number A„ and an orthonormal basis h n of H such that T u can 
be written as 

T u {x) = ^ A„ (h n , x) h n for all x 6 H; (7) 

n=l 

moreover u can be written as 

u =};X n h„ ® h n . (8) 
»=i 

To each element tp of (H® n H)* we associate a bilinear continuous opera- 
tor Bjp and a linear continuous operator Lj, : H — >• i? (see [53] page 24, the 
discussion before Proposition 2.11 Section 2.2) such that 

(L^,(x),y) = B^{x,y)=ij)(x®y) for all a;, y E H. (9) 

Proposition 2.6. Let it E H^^H and ip G (H^ n H)* with associated maps 
T„ e C{H,H),B^, e d(H,H). Then 

(H®„H)* u )h®„h = Tr l^^) . 

Proof. The claim follows from what we have recalled above. Indeed, using ([SJ 
and © we have 

(+oo \ +oo 

^ A„/i n ® /i„ J = (L^(X n h n ),h n ) 
z=l / n=l 

and last expression is exactly Tr (T U B^) when we compute it using the basis 
h n - □ 

3 Stochastic integrals 

We adopt the notations introduced in Section [2] 

Definition 3.1. Let X: fi x [s,T] -)• C(U,H) and Y: fi X [s,T] U be two 
stochastic processes. Assume that Y is continuous and X is strongly measurable. 
If for almost every t G [s, T] £/ie following limit exists in probability 

jTx(r)d-Y(r) :=^jf X(r) ^ + ^ Y W) dr 

and t/ie process 1 t— > f X(r) d~ Y(r) admits a continuous version, we say that X 
is forward integrable with respect to Y. T/ia£ version of J X(r) d _ Y(r) is called 
forward integral of X with respect to Y. 

Remark 3.2. TTie definition above is a natural generalization of that given in 
f!5f Definition 3.4; there the forward integral is a real valued process. 



13 



3.1 The case of Q- Wiener process 

Consider a positive and self-adjoint operator Q 6 C(U, U). Even if not necessary, 
we assume Q to be injective; this allows to avoid formal complications. However 
Theorem 13.41 below holds without this restriction. 

Define U := Q 1/2 {U): U is a Hilbert space for the inner product 
(x,y) u := {Q^ 1 ^ 2 x,Q^ 1 / 2 y s ) u and, clearly Q 1 / 2 : U — > Uq is an isometry, see 
e.g. [T$] Section 4.3 for details. We remind that, given A g C-2{Uq,H), we have 
U\\l 2[UoM) =Tr(AQ^{AQ^Y). 

Let W Q = {W Q (<) : s < f < T} be an [/-valued J^-Q- Wiener process with 
Wq(s) = 0, P a.s. The definition and properties of Q- Wiener processes are 
presented for instance in [55] Chapter 2.1. 

If Y is predictable with some integrability properties, J Y(r) dW(r) denotes 
the classical Ito-type integral with respect to W, defined e.g. in |10| . 

In the sequel it is shown to be equal to the forward integral so that the 
forward integral happens to be an extension of the Ito integral. In the next 
subsection we introduce the Ito integral / Y(r) dM(r) with respect to a local 
martingale M. If H = R, previous integral will also denoted /'(Y(r), dM(r))j/. 

Definition 3.3. We say that a sequence of -stopping times r n : fi — > [0, +oo] 
is suitable if, called 

Q„ := {to £ SI : T n (w) > T] , 

we have 

fl n C r2„ + i a.s. for all n 

and 

M Q, n = Q a.s. 

In the sequel, we will use the terminology "stopping times" without mention 
to the underlying filtration ^ . 

Theorem 3.4. Let X: [s, T] x SI — > C2{Uq, H) be a predictable process satisfying 

J \\ X ( r )Wc 2 (u ,H) a.s. (10) 

Then the the forward integral 

X(r) d"W Q (r). 

exists and coincides with the classical ltd integral ( defined for example in JlCfy 
Chapter 4 ) 

X(r) dWq(r). 
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Proof. We fix t € [s,T]. In the proof we follow the arguments related to the 
finite-dimensional case, see Theorem 2 of [52 . 
As a first step we consider X with 



E 



|Xfa)| 



dr/ < +oo. 



(11) 



This fact ensures that the hypotheses in the stochastic Fubini Theorem 4.18 
of [TU] are satisfied. 
We have 



W) W ^ + £ >- 



dr = 



1 



X(r)- 



dW o (0) dr 



applying the stochastic Fubini Theorem, the expression above is equal to 
ft / 



(r)dr dW Q {0) +R e (t) 



where R e (t) is a boundary term that converges to ucp, so that we can ignore 
it. We can apply now the maximal inequality stated in [51], Theorem 1: there 
exists a universal constant C > such that, for every / £ L 2 ([s,t};M.), 



f* ( sup - f f(OdA dr<C /*/ 2 (r)dr. 

Js \e£(0,l] e J{r-e) J Js 



(12) 



According to the vector valued version of the Lebesgue differentiation Theorem 
(see Theorem II. 2. 9 in [H]), the following quantity 



(r-e) 



converges dP® dr a.e. to X(r). Consequently (|T2|) and dominated convergence 
theorem imply 



E 



X(r) dr - X(0) 



d0^>O. 



C 2 (U ,H) 



Finally, the convergence 



X(r)dr dW Q (0)-^-> J 



X(0)dW o (0), (13) 



justifies the claim. 

If pT|) is not satisfied we proceed by localization. Denote again with J e and 
J the processes defined in (fT3")) . Call r„ the stopping times given by 



r„ := inf it G [s, T] : jf 
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(and +00 if the set is void) and call O n the sets 

Q„ := {ui G SI : r n (uj) > T} . 
It is easy to see that the stopping times r„ are suitable in the sense of Definition 
For each fixed n, the process Jr SiT iX verifies (fTTj) and from the first step 

Jn~ f (-I I[s,r n ](rMr)dr 



-^-> J n := [ I [s , Tn] (6)X(9)dW(9). (14) 

SO 

L 2 (fl,H) 

Consequently, for all n, In„Je converges to Io n J in probability and finally J e 
converges to J in probability as well. This fact concludes the proof. □ 



3.2 The semimartingale case 

Consider now the case when the integrator is a more general local martingale. 
Let H and U be two separable Hilbert spaces and we adopt the notations in- 
troduced in Section [21 

An [/-valued process M: [s, T) x il — > U is called martingale if, for all t € 
[s,T], M is ^/-adapted with E [|M(*)|] < +00 and E [M^J^J = M(fi) for 
all s < t\ < £2 < T. The concept of (conditional) expectation for £>-valued 
processes, for a separable Banach space B, are recalled for instance in [TU] 
Section 1.3. All the considered martingales will be continuous. 

We denote with Ai 2 (s,T; H) the linear space of square integrable martin- 
gales equipped with the norm 

|M| A4 2 (s , T . C7) := (E sup |M(i)| 2 
V te[*,r] 

It is a Banach space as stated in jXOJ Proposition 3.9. 

An {/-valued process M: [s,T] x Q U is called local martingale if there 
exists a non-decreasing sequence of stopping times r„ : SI — > [s, T] U {+00} such 
that M(f A r„) for t £ [s, T] is a martingale and P [lirrin^oo r„ = +00] = 1. All 
the considered local martingales are continuous. 

Given a continuous local martingale M: [s, T] x fl — > U, the process |M| 2 is a 
real local sub- martingale, see Theorem 2.11 in [35] . The increasing predictable 
process, vanishing at zero, appearing in the Doob-Meyer decomposition of |M| 2 
will be denoted by [M] R ' d (i),i e [s,T[. It is of course uniquely determined and 
continuous. 
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We remind some properties of the ltd stochastic integral with respect to a 
local martingale M. Call Im(s,T; H) the set of the processes X: [s,T] x O — > 
£(U; H) that are strongly measurable from ([s, T] x il, <&>) to C(U; H) and such 
that 

,t \ 1/2 

|2 ,q r^/irl^: c ^ I +00 



|X|i m(s> t ;H ) := ^ J s \\X(r)\\i {u . M) d[Mr ct (r)^ 

Im(s,T; H) endowed with the norm | • \x M ( s ,T;H) is a Banach space. 
The linear map 

I:X u (s,T;H) ->M 2 (s,T;H) 
X 1 ^ jj X(r) dM(r) 

is a contraction, see e.g. [41J Section 20.4 (above Theorem 20.5). As illustrated 
in [35] Section 2.2 (above Theorem 2.14), the stochastic integral w.r.t. M ex- 
tends to the integrands X which are strongly measurable from ([s,T] x fl, ZP) 
to C(U ; H) and such that 



r 



\c(U;H) 



d[M] R ' c '(r) < +00 a.s. (15) 



We denote by J 2 (s,T\U,H) such a family of integrands w.r.t. M. Actually, 
the integral can be even defined for a wider class of integrands, see e.g. |42| . 
For instance, according to Section 4.7 of [TD], let 

M* = J A(r)dW Q (r),t6 [s,T], (16) 

and A be an C(U, 7J)-valued predictable process such that 

fj Tr[A(r)Q^ 2 (A(r)Q^ 2 )*}dr < 00 a.s. 

If X is an f/-valued (or ff*-valued using Riesz identification) predictable 
process such that 

T 

(X(r),A(r)Q 1 / 2 (Ag 1 / 2 )*X(r)) ff dr < 00, a.s., (17) 
then, as argued in Section 4.7 of [TO] . 

N(t) = [ (X(r), dM(r)) H ,t e [s,T], (18) 



is well-defined and it equals AT(f) = £(X(r),A(r) dW Q (r)) H for f e [s,T]. 

The stochastic integral with respect to local martingales, fulfills some signif- 
icant properties recalled in the following proposition. 

Proposition 3.5. Let M be a continuous (T^-local martingale, X verifying 
([To]). We set N(t) = f*X(r)<M{r). 
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(i) N is an (F^-local martingale. 

(ii) Let K be an (J 7 /)- predictable process such that EX fulfills (|15p . T/ien 
the Ito-type stochastic integral J s K.dN for t 6 [s, T] is well-defined and it 
equals f*KK(M. 

(Hi) IfM. is a Q- Wiener process Wq, then, whenever X is such that 

Tr (x(s)Q 1 / 2 ) (X(s)Q 1 / 2 )* ds < +00 a.s. (19) 
£/ien N(t) = J'XfsJdWgfs) is foca/ martingale and 

[Nf' cL (t) = |* (x( s )g 1 /2) (x( s )g 1 /2)* ds . 

(w,) // in iiem (liij, £/te expectation of the quantity (|19p is finite, then N(t) = 
J X(s)rfWg(s) is square integrable continuous martingale. 

(v) IfM. is defined as in (|16p and X fulfills (|17p , i/ien M is a reaZ Zoca/ mor- 
tingale. If moreover, the expectation of (jTTJ) is finite, then N , defined in 
A18\) , is a square integrable martingale. 



Proof. For (i) see [35] Theorem 2.14 page 14-15. For (ii) see [42], proof of 
Proposition 2.2 Section 2.4. (iii) and (iv) are contained in [TU] Theorem 4.12 
Section 4.4. (v) is a consequence of (iii) and (iv) and of the considerations before 
the statement of Proposition 13.51 □ 

Theorem 3.6. Let us consider a continuous local martingale M: [s, T] x Q — > 
U and a caglad process predictable C(U,H) -valued process. Then the forward 
integral 



X(r) d~M(r). 

defined in Definition \3.1\ exists and coincides with the ltd integral 

X(r) dM(r). 



Remark 3.7. Any caglad adapted process is a.s. bounded and therefore it be- 
longs to J 2 (s,T;U,H). 

Proof of Theorem \3.6l Replacing X with (X — X(s)) there is not restriction to 
generality to suppose that X(s) = 0. 

The proof follows partially the lines of Theorem 13.41 Similarly we first lo- 
calize the problem using the stopping time 

r„:=inf{ie [s,T] : \\X(t)fc(u, H ) + [Mf< cl (t) > n] 
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(and +00 if the set is void); the localized process belongs to Xm{s,T; H) and 
satisfies the hypotheses of the stochastic Fubini theorem in the form given in 
|36) . Since the integral is a contraction from 2"m(s, T; H) to Ai 2 (s, T; H), it only 
remains to show that 



E 



X(r) dr - X(f) 



d[M] K,c( (0 ^>0 



(20) 



C(U,H) 



when X belongs to Xu(s,T; H). ([20]) holds, taking into account Lebesgue 
dominated theorem, because X is left continuous and both X and [M] R ' ci are 
bounded. □ 

An easier but still important statement concerns the integration with respect 
bounded variation processes. 

Proposition 3.8. Let us consider a continuous bounded variation process 
V: [s, T] xfi — >■ U and let X be a caglad measurable process [s, T] x Q — > C(U, H). 
Then the forward integral 

f X(r)d - V(r). 

J s 

defined in Definition \3.1\ exists and coincides with the Lebesgue- Bochner integral 



X(r) dV(r) 



Proof. The proof is similar to the one of Theorem I3.6( one proceeds via Fubini 
theorem. □ 



4 x -c l ua dratic variation and x-Dirichlet processes 
4.1 %-quadratic variation processes 

Denote with ^([s,T]) the space of the real continuous processes equipped with 
the ucp (uniform convergence in probability) topology. 

Consider two real separable Hilbert spaces Hi and H2 equipped with norms 
I ■ |i and I • |a. Following [15l[T4] a Chi-subspace (of (Hx^^Hi)*) is defined as 
any Banach subspace (x, \ • \ x ) which is continuously embedded into (Hi<^) 7T H2)*'. 
in other words, there is some constant C such that 

I ' l(Hi®„H 2 )« ^ C \ " lx- 

Lemma 4.1. Let us consider a Banach space v\ [resp. v-i] continuously em- 
bedded in [resp. H^]. Define \ '■= v\®- K V2- Then \ can be continuously 
embedded in (-Hi® 7^2)* ■ In particular, after there exists a constant C > 
such that for all h6^, 

W\ (Hl ^ H2) * < C\u\x, (21) 

after having identified an element of \ with an element of {Hx®^H2)* ■ In other 
words x is a Chi-subspace of (H±<S) n H2)* ■ 
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Remark 4.2. In particular is a a Chi- sub space, of (ifi®,,-/^)* 

Proof of Lemma \4-1\ To simplify the notations assume the norm of the injec- 
tions v± ^ HI and V2 fl| to be less or equal than 1. We remind that 
(ifi<8>7ri?2)* is isometrically identified with the Banach space of the bilinear 
bounded forms from Hi x H2 to R, denoted by B(Hi, H2). 

Consider first an element u £ x °f the form u — ^ i=1 a* ® 6* for some 
a* G fi and 6* € 2^2 . u can be identified with an element of B{H\, H2) acting as 
follows 

n 
i=l 

We can choose a* £ ^1 and b* £ ^2 such that u = X)"=i a l ® &i an< ^ 



inf "I ^2 \ x i\»i \yiW '■ u = ^2xi®y i} Xi £ v\, y t £ v 2 j 

n 

> + (22) 



. i=l i=l 



i=l 

Using such an expression for u we have that 



M\B(H U H 2 ) 



sup 

I0|l,l</>|2<1 



< SUp V] |ai|i|0|i|&i| 2 |-0|2 < V" |ai|l| & i|2 

l*ll.l*l»<l i=1 i=l 



< 



E 



l i \v\ \ u i \ vi 



(23) 



Since e is arbitrary, we conclude that HuHg^ - '■- \ u \x- 

Since this proves that the application that associates to it £ Vi^>„V2 its 
corresponding element in B{H\, H2), has norm 1 on the dense subset v\® v v 2 ^ 
then the claim is proved. □ 

Remark 4.3. Even though the Chi-subspaces of tensor product type, described 
in Lemma \4-1\ are natural, there are examples of Chi-subspace not of that form, 
see e.g. Section 2.6 in 

Let x be a generic Chi-subspace. We introduce the following definition. 

Definition 4.4. Given X [resp. Y] a H\-valued [resp. H2-valued] process, 
we say that X and Y admit a x~covariation if the two following conditions are 
satisfied. 
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HI For any sequence of positive real numbers e n \ jt there exists a subsequence 
e nk such that 

[T |(J (X(r + e n J - X(r)) ® (Y(r + e n J - Y(r)))| x , 
sup / —as < oo a.s. 

k Js e "fe 

(24) 

H2 If we denote by [X, Y]* i/ie application 

{ [X,Y]« ►tftfs.T]) 

r / J ((X(r + e) - X(r)) (Y(r + e) - ¥(r))) \ ^ 



(25) 

where J : HitB) n H2 — > {H\®- K H2)** is the canonical injection between a 
space and its bidual, the following two properties hold. 

(i) There exists an application, denoted by [X, Y] x , defined on X with 
values in c (a{{s,T\), satisfying 

[X,Y]^)-^[X,Y] x (0) (26) 

for every <p G x C (.Hi®,^)* . 

(ii) There exists a strongly measurable process [X, Y] : f2 x [s, T] — > x* > 
such that 

• for almost allui £ 17, [X, Y] (w, •) is a (cadlag) bounded variation 
process, 

• jX/5y-,*)(0) = [X,Y] X (0)(.,t) a.s. /or all <f> e X , t e [s,T]. 

Remark 4.5. Since, (Hx^^H^)** is continuously embedded in x* , tten J(a®b) 
can be considered as an element of x* ■ Therefore we have 

| J(a <g> 6)| x * = sup (J{a®b),4>) = sup |0(a®6)|. 

06X,l0lx<l 06X,l0lx<l 

We can apply this fact to the expression (|24p considering a = X(r + e nfc ) — X(r) 
andb = Y(r + e„J )-Y(r). 

Remark 4.6. Aw easy consequence of Remark 3.10 and Lemma 3.18 in \1I$ is 
the following. We set 

[T |(J(X(r + e)-X(r))®(Y(r + e)-Y(r)))| 
A(e) := y ^dr. (27) 

i. //lim e ^o^.(£) exists in probability then Conditional of Definition ^ -4\ is 
verified. 
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2. //lim^o A(e) — in probability then X and Y admit a \-covariation and 
[X, Y] vanishes. 

If X and Y admit a ^-covariation W e call ^-covariation of X and Y the 
X*-valued process [X, Y] denned for every w G £1 and i G [ S >T] by i— > 
[X/Y] (w, t)(0) = [X, Y] x O)(w,i). By abuse of notation, [X,Y] X will also be 
often called x-covariation and it will be confused with [X, Y] . 

Definition 4.7. If x — {H\® 7! H2)* the \-covariation is called global covaria- 
tion. In this case we omit the index (Hi^^H?)* using the notations [X, Y] and 

[Xjj. 

Remark 4.8. The notions of scalar and tensor covariation have been defined 
in Definitions \1.3\ and \1.6\ 

• Suppose that X and Y admits a scalar quadratic variation and (X, Y) has 
a tensor covariation, denoted with [X, Y]®. Then X and Y admit a global 
covariation [X,Y]. In particular, recalling that Hi®^H2 is embedded in 

(Hi<S> n H2)** , we have [X, Y] = [X, Y]®. The proof is a slight adaptation 
of the one of Proposition 3.14 in \1J$ . In particular condition HI holds 
using Cauchy-Schwarz inequality. 

• If X admits a scalar zero quadratic variation then, by definition, the ten- 
sor covariation of (X, X) also vanishes. Consequently, by item (i) X also 
admits a global quadratic variation. 

Remark 4.9. The following properties hold. 

1. If M. is a continuous local martingale with values in H then M has a scalar 
quadratic variation, see Proposition 1.7 in \1J$ . 

2. If 'M is a continuous local martingale with values in H then M has a tensor 
quadratic variation. This fact is proved in Proposition 1.6 of JJ^f . Using 
similar arguments one can see that i/Mx [resp. M2/ is a continuous local 
martingale with values in Hi [resp. Hi] then (Mi,M2) admits a tensor 
covariation, see \14V - 

Remark 4.10. If X and Y admit a global covariation then they admit a \~ 
covariation for any Chi-subspace \- Moreover [X,Y] x (0) = [X,Y](0) for all 

We say that a process X admits a x-quadratic variation if X and X admit 

a x-covariation. The process [X, X] , often denoted by [X] , is also called \~ 
quadratic variation of X. 

Remark 4.11. In \11$ the definition and the concepts that we have recalled 
are introduced when Hi and H2 are Banach spaces. For our purposes we can 
restrict ourself to separable Hilbert spaces. 
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Remark 4.12. For the global covariation case (i.e. for x — (Hi^^Hs)* ) the 
condition HI reduces to 

f T 1 

sup/ |(X(r + e n J-X(r))| 1 |Y(r + e„J-Y(r))| 2 ds < <x a.s. 

k Js e "fc 

In fact the embedding of [Hi^^Hi) in its bi-dual is isometric and, for x £ H\ 
and y £ H 2 , \x ® y\ {Hl ® w H 2 ) = \ x \i\vU- 

The product of a real finite quadratic variation process and a zero real 
quadratic variation process is again a zero quadratic variation processes. Under 
some conditions this can be generalized to the infinite dimensional case. 

Proposition 4.13. Let i = 1, 2 and it\ be a continuous embedded Hilbert sub- 
space of H* . Let consider the Chi-subspace of the type Xi = v\®-nH 2 an d 
X2 = H*®^V2, Xi = Vi®^Vi, i — 1,2. Let X (resp. Y) be a process with values 
in Hi (resp. Hi). 

1. Suppose that X admits a xi-Q ua dratic variation and Y a zero scalar 
quadratic variation. Then [X,Y] Xl =0. 

2. Similarly suppose that Y admits a Xi~ quadratic variation and X a zero 
scalar quadratic variation. Then [X, Y] X2 = 0. 

Proof. We remark that Lemma 14.11 imply that Xi an d Xi-, * = 1?2 are indeed 
Chi-subspaces. By item 2. of Remark l4.6l it is enough to show that A(e) defined 
in (I27p converge to zero, with x = Xi?* = 1, 2. By symmetrical reasons it is 
enough to show item 1. 

We set x — Xi- Via Riesz, we identify H\ as a subspace of v\. We remark that, 
by the usual identifications, we have 

3{H X ®^H 2 ) c (ffi® w ff a )** C x*- 

Let a £ Hi C v* , b £ H 2 , so a* £ Vi. By definition and by Lemma [2^41 we have 

\J{a® b)\ x * = \i(a* (8) b*)\ x * = \a*\ Vl \b\ B% . 

Consequently, using also Riesz identification, with a = X(r + e) — X(r) and 
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b = Y(r + s) - Y(r) for r G [s, T], we have 

/• T |(J(X(r + e)-X(r))®(Y(r + e)-Y(r)))| x . 
A{e) = I —dr. 

J s ^ 

= / \X(r + s)-X(r)\ vt \Y(r + s)-Y(r)\ H2 - 

J S ^ 

< {j* |X(r + e) - X(r)£. ^ |Y(r + e) Y(r)| 2 ff2 



|(J (X(r + e) - X(r)) ® (X(r + e) - X(r)))L. 



\ 1/2 



e 

2 \ 1/2 



|Y(r + e)-Y(r))| g3 dr 



The fourth line is explained by the fact that, setting a = X(r + e) — X(r) so 
a e i/J, J(a ® a) being assimilated to a bounded bilinear form on \ii we have 

|J(a®a)| = sup | x * (J(a ® a), tp <8> ■0)xi I 

lvki<i>l^kil<i 

sup 1^(^,0)^1 sup 1^(^,0)^1 = 
lvki<i l^ki<l 

The condition HI related to the xi-quadratic variation of X and the zero scalar 
quadratic variation of Y, imply that previous expression converges to zero. □ 

When one of the processes is real the formalism of global covariation can be 
simplified as shown in the following proposition. Observe that, according to our 
conventions, | • | represents both the norm in H and the absolute value in K. 

Proposition 4.14. Let be X: [s,T] x £1 — >• H a Bochner integrable process and 
Y : [s, T] x Q — > R a real valued process. Suppose the following. 

(a) For any e, - J T |X(r + e) — X(r)\\Y(r + e) — Y(r) \ dr is bounded by a r.v. 
A e such that A e converges in probability when e — > 0. 

(b) For every h G H the following limit 

1 f* 

C(t)(h):= lim - / (h,X(r + e)-X(r))(Y(r + e)-Y(r))dr 
e^o+ e J s 

exists ucp and there exists a continuous process C : [s,T] x £1 — >• H s.t. 

'C(t,u),hj =C(t)(h)(ui) forF-a.s. w G Q, 
for all t G [s, T] and he H. 
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If we identify H with (H^^W)* , then X and Y admit a global covariation and 

c = [x^yj. 

Proof. Taking into account the identification of H with (H® n M.)* the result is 
a consequence of Corollary 3.26 of P3]. In particular condition HI follows from 
Remark HUl 

□ 

4.2 Relations with tensor covariation and classical tensor 
covariation 

The notions of tensor covariation recalled in Definition 1 1 . 61 concerns general pro- 
cesses. In the specific case when Hi and H 2 are two separable Hilbert spaces 
and M: [s, T] x fi — > Hi, N: [s, T] x £1 — > H 2 are two continuous local martin- 
gales, another (classical) notion of tensor covariation is defined, see for instance 
in Section 23.1 of gl]. This is denoted by [M,N] d . Recall that the notion 
introduced in Definition [L6] is denoted with [M, N]®. 

Remark 4.15. We observe the following facts. 

(i) According to Chapter 22 and 23 in Utf , given a Hi-values [resp. Hi- 
valued] continuous local martingale M [resp. N/, [M, N) cl is an (Hi^i^Hi)- 
valued process. Recall that [Hi^^Hi) C [Hi^^Hz)** . 

(ii) Taking into account Lemma \2.J\ we know that, given h £ Hi and k £ Hi, 
h* ® k* can be considered as an element of (H±® n H2)* . One has 

[M, N] cl (t)(h* <g> k*) = [(M, h) (N, k)] cl (t), (28) 

where h* [resp. k*[ is associated with h [resp. k[ via Riesz theorem. This 
property characterizes [M, N] cl , see e.g. Section 3.4 after Proposition 

3.11. 

(Hi) If H2 = K and N = N is a real continuous local martingale then, identify- 
ing Hi^^Hi with Hi, [M, N] cl can be considered as a Hi-valued process. 
The characterization (28\) can be translated into 

[M, N} cl (t)(h*) = [(M, h) , N] cl {t). (29) 

By inspection, this allows us to see that the classical covariation between 
M and N can be expressed as 

[M, N] cl {t) := M(t)N(t) - M(s)N(s) - f N(r) dM(r) - f M(r) dJV(r). 

J S J S 

(30) 

Lemma 4.16. Let H be a separable Hilbert space. Let M [resp. N/ be a continu- 
ous local martingale with values in H. Then (M, N) admits a tensor covariation 
and 

[M,N]® = [M,N] ci . (31) 
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In particular M and N admit a global covariation and 

[M^N] = [M, E] cl . (32) 

Proof. Thanks to Remark 14.91 M and N admit a scalar quadratic variation and 
(M,N) a tensor covariation. By Remark l4.8l thev admit a global covariation. It 
is enough to show that they are equal as elements of (H\® n H2)** so one needs 
to prove that 

[M,N]®(0) = [M,N] d (0) (33) 

for every (f> £ (Hi® w H 2 )* . 

Given h £ Hi and k £ H2, we consider (via Lemma 12.41) h* ® k* as an 
element of (iJi®^^)*- According to Lemma T4. 171 below. H^^H^ i s dense in 
{Hi® 7T H2)* in the weak-* topology. Therefore, taking into account item (ii) of 
Remark 14.151 we only need to show that 

[M,N]®(/i*<g>fc*) = [(MU)(N,fc)] d , (34) 

for every h £ -Hi, £ H 2 . By the usual properties of Bochner integral the left 
hand side of (|34j) is the limit of 



- j (M(r + e) - M{r)) <g> (N(r + e) - N(r))(h* ® k*)dr 

^ J S 

= - f ((M{r + e)-M(r)),h)(®(N(r + e)-N(r)),k)dr. (35) 

^ J s 

Since (M, h) and (N,fc) are real local martingales, the covariation [(M, h)(N, k)] 
exists and equals the classical covariation of local martingales because of Propo- 
sition 2.4(3) of [50]. □ 

Lemma 4.17. Let Hi,H 2 be two separable Hilbert spaces. Then Hi^^H^ is 
dense in (Hi®^^)* in the weak-* topology. 

Proof. Let (e^) and (fi) be respectively two orthonormal bases of Hi and H 2 . 
We denote with V the linear span of finite linear combinations of &i® fi. Let 
T £ (Hi<S> 7r H2)* ., which is a linear continuous functional on Hi®^H 2 . Using 
the identification of (Hi^> 7r H2)* with B(H±, H2), for each n £ N, we define the 
bilinear form 

i—n 

T n (a, b) := ^ {a, ei) Hi (b, f t } H2 T(e h fi). 

i=l 

It defines an element of H^^H^ C (i^iCS)*-^)* ■ It remains to show that 

(H^H^M Hl ^H 2 (H^H^^H^H^ fOT a11 1 e Hi®«H 2 . 

We show now the following. 

(i) T n (a, b) T(a, b) for all a £ Hi . b £ H2 ■ 
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(ii) For a fixed I e Hi^^H^, the sequence T n {l) is bounded. 
Let us prove first (i). Let a £ Hi and b € Hi- We write 

(n n \ 

i=l i=l / 

Since 

n 

(a, e^) "^ + °°> a in f/i 



and 



(i) follows, being T a bounded bilinear form. 

Let us prove now (ii). Let e > fixed and Iq £ T> such that \l— ^o|ir l( a h ^ e - 
Then 

|T n (i)| < \T n (l-l )\ + \T n (l )\ < \T n \ {Hi ^ H2) ,\l-l Q \ Hi ^ H2 + \T n (l Q )\. (37) 
So (13"T1) is bounded by 

l T l(H 1 ®„H 2 )* e + sup|T„(fo)| 

recalling that the sequence (T u (Iq)) is bounded, since it is convergent. Finally 

(ii) is also proved. 

At this point (i) implies that 

(H l ® 7t H 2 )' l \ T ^ 1 ) H^H* {H^HzyiT^H^HS for &U 1 G V ' 

Since "D is dense in H\®. 1T Ll2 , the conclusion follows by Banach-Steinhaus the- 
orem, see Theorem 18, Chapter II in [20J. □ 

We recall the following fact that concerns the classical tensor covariation. 

Lemma 4.18. Let Wq be a Q-Wiener process as in Subsection \3.1l Let 
: ([s,T] x tt, &) — > £2(Uo,H) be a strongly measurable process satisfying con- 
dition Iil0\) . Consider the local martingale 

M(t) := f *(r)dW Q (r). 

Then ^ 

[M,M] d (t) = J g(r)dr. 

where g(r) is the element of H^)^H associated with the nuclear operator 
G g (r) := (*(r)g 1 /2)(*( r )gV2 
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Proof. See [TU] Section 4.7. □ 



Lemma 4.19. Let M: [s, T] x 51 — > H be a continuous local martingale and 
Z a strongly measurable process from ([s,T] x Q,&) to H and such that 
< +oo a.s. Of course Z can be Riesz-identified with 
an element of J 2 (s,T;H*,R). We define 



X(t) := J (Z(r), dM(r)> . (38) 

Then, X is a real continuous local martingale and for every continuous real local 
martingale N, the (classical, one- dimensional) covariation process [X, N] cl is 
given by 

[X,N] cl (t) = J (Z(r), d[M,iV] c/ (r)) ; (39) 
in particular the integral in the right side is-well defined. 

Proof. The fact that X is a local martingale is part of the result of Theorem 
2.14 in [35j . For the other claim we can reduce, using a sequence of suitable 
stopping times as in the proof of Theorem l3.6[ to the case in which Z, M and TV 
are square integrable martingales. Taking into account the characterization (|29p 
and the discussion developed in [321, P a g' e 456, (151?)) follows. □ 

Proposition 4.20. IfM: [s,T]xQ ->• H and N : [s,T]xCl -> R are continuous 

local martingales. Then M and N admit a global covariation and [M, N] — 
[M,N] cl . 

Proof. We have to check the conditions stated in Proposition 14.141 for C equal 
to the right side of (|30|) . Concerning (a), by Cauchy-Schwarz inequality we have 



T 

|JV(r + e) - N(r)\\M(r + e) -M(r)|dr < [iV,^] 6 ' 1 



Since both N and M are local martingales they admit a scalar quadratic vari- 
ation (as recalled in Remark 14. 9p . the result is established. Concerning (b), 
taking into account ([29| we need to prove that for any h G H 



lim- / (M h (r + e)-M h {r))(N(r + e)-N(r))dr= [(M,h),N} cl (40) 



e-S-0 e 



ucp, where M h is the real local martingale (M,h). (|4"0")) follows by Proposition 
2.4(3) of [50|. □ 
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4.3 ^-Dirichlet and v-weak Dirichlet processes 



We have now at our disposal all the elements we need to introduce the concept 
of x-Dhichlet process and ^-weak Dirichlet process. 

Definition 4.21. Let\ Q (H^^H)* be a Chi-subspace. A continuous H -valued 
process X: ([s,T] x Q, —> H is called ^-Dirichlet process if there exists a 
decomposition X = M + A where 

(i) M is a continuous local martingale, 

(ii) A is a continuous x~zero quadratic variation process, 
(in) A(0) = 0. 

Definition 4.22. Let H and Hi be two separable Hilbert spaces. Let 
v C (H® T Hi)* be a Chi-subspace. A continuous adapted H-valued process 
A: [s, T] x 51 — >• H is said to be ^"/-^-martingale-orthogonal if 

[A,N]„ = 

for any H\-valued continuous local martingale N. 

As we have done for the expressions "stopping time", "adapted", "pre- 
dictable"... since we always use the filtration , we simply write v -martingale- 
orthogonal instead of ^"/-^-martingale-orthogonal. 

Definition 4.23. Let H and Hi be two separable Hilbert spaces. Let v C 
(H<S>^Hi)* be a Chi-subspace. A continuous H-valued process X: [s, T] x f2 — > H 
is called z^-weak-Dirichlet process if it is adapted and there exists a decomposi- 
tion X = M + A where 

(i) M is a H-valued continuous local martingale, 

(ii) A is an v -martingale- orthogonal process, 
(in) A(0) = 0. 

Remark 4.24. The sum of two v ■ -martingale- orthogonal processes is again a 
v -martingale- orthogonal process. 

Proposition 4.25. 1. Any process admitting a zero scalar quadratic vari- 
ation (for instance a bounded variation process) is a v -martingale- 
orthogonal process. 

2. Let Q be an equivalent probability to P. Any v-weak Dirichlet process under 
¥ is a v-weak Dirichlet process under Q. 

Proof. 1. follows from Proposition 14. 131 1. setting vi = In fact, any local 
martingale has a global quadratic variation because of Remark 14.81 and Remark 
14.91 So it has a i/i<g) w i/i-quadratic variation by Remark 14.21 and Remark 14.101 
Concerning 2., by Theorem in Section 30.3, page 208 of [41j, a local martingale 
under P is a local martingale under Q plus a bounded variation process. The 
result follows by item 1. and Remark 14.241 since the i/-covariation remains 
unchanged under an equivalent probability measure. □ 
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We recall that the decomposition of a real weak Dirichlet process is unique, 
see Remark 3.5 of [33] • For the infinite dimensional case we now establish the 
uniqueness of the decomposition of a i/-weak-Dirichlet process in two cases: 
when Hi = H and when H± = M. 

Proposition 4.26. Let v C {H^H)* be a Chi-subspace. Suppose that v is 
dense in [H®^!!)* . Then any decomposition of a v -weak-Dirichlet process X is 
unique. 

Proof. Assume that X = M 1 + A 1 = M 2 + A 2 are two decompositions where M 1 
and M 2 are continuous local martingales and A 1 , A 2 are j/-martingale-orthogonal 
processes. If we call M := M 1 - M 2 and A := A 1 - A 2 we have = M + A. 

By Lemma 14.161 M has a global quadratic variation. In particular it also 
has a ^-quadratic variation and, thanks to the bilinearity of the ^-covariation, 

= [M, 0]„ = [M, M + A]„ = [M, M]„ + [M, A]„ = [M, M]„ + = [M, M] v . 

We prove now that M has also zero global quadratic variation. We denoted 
with C([s,T]) the space of the real continuous processes defined on [s,T]. We 
introduce, for e > 0, the operators 

f [M,M] e : (H^H)* ^C([s,T}) 

1 1 /•* ( 41 ) 
( ([M,MY(mt)^-J s {H ^ H) ((M r+e -M r )^^) (H ^ Hr dr. 

Observe the following 

(a) [M, M] e are linear and bounded operators. 

(b) For <p S (H^H)* the limit [M, M] (</>) := lim e ^ [M, M] e (0) exists. 

(c) If <j) e v we have [M, M](0) = 0. 

Thanks to (a) and (b) and Banach-Steinhaus theorem (see Theorem 17, Chapter 
II in [50]) we know that [M,M] is linear and bounded. Thanks to (c) and the 
fact that the inclusion v C [H®^H)* is dense it follows [M, M] = 0. By Lemma 
14.161 [M, M] coincides with the classical quadratic variation [M,M] d and it is 
characterized by 

= [M,M] ci (h*,k*) = [(M,h), (M,fc)] d . 

Since M(0) = and therefore (M, h)(0) = it follows that (M, h) = for any 
h G H. Finally M = 0, which concludes the proof. □ 

Proposition 4.27. Let H be a separable Hilbert space. Let v C H* = (H^i^M.)* 
be a Banach space with continuous and dense inclusion. Then any decomposition 
of a v -weak- Dirichlet process X with values in H is unique. 

Remark 4.28. Taking into account the identification of H* with (H^^M.)* it 
is possible to consider is as a dense subset of (H^^R)* which is a Chi-subspace. 
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Proof of Proposition We denote again the H inner product by (•,•)■ We 

show that the unique decomposition of the process is trivial. Assume that 
= X = M + A. Since v is dense in H* it is possible to choose an orthonormal 
basis e* in v. We introduce M % := (M, ej), they are continuous real local 
martingales and then, thanks to the properties of A we have 

= [X,M% = [M,M% + [A, M'% = [M,M%. 

By Remark 14.101 Proposition 14.201 and Remark 14.151 (iii) we know that 

([M,M%, ei ) = (\M,M i ] el ,e i ) = [M\M l ] cl ; 

so M % = for all i and then M = 0. This concludes the proof. □ 

Proposition 4.29. Let H and Hi be two separable Hilbert spaces. Let \ — 
Xo$5>kXo f or some \o Banach space continuously embedded in H* . Define v — 
Xo®-nH\- Then an H -valued continuous zero \- quadratic variation process A is 
a v -martingale-orthogonal process. 

Proof. Taking into account Lemma [4.11 \ is a Chi-subspace of (H^^H)* and 
v is a Chi-subspace of {H%>^Hi)* . Let N be a continuous local martingale with 
values in H\. We need to show that [A, N]„ = 0. We consider the random maps 
T e : v x n -> C([s,T}) defined by 

T\<f) := [A, FC(0) = - / „.<(A(r + e) - A(r)) ® (N(r + e) - N(r)),<t>) v dr, 

^ J s 

for </> G v. 
Step 1 : 

Suppose that <fi = h* <8)k* for h* e xo and k G H%. Then 



T^){t) 



x . ((A(r + e) - A(r)),h*) xo ((N(r + e) - N(r)), k) Bl dr 



< 



x . <(A(r + e) - A(r)), ft*)^ dr / ((N(r + e) - N(r)), k) Hi dr 



1/2 



X* 



((A(r + e) - A(r))® 2 ,/i* ® ft*) dr 



H M ((N(r + 6) - N(r))® 2 , fc* ® fc*> (Hl ^ Hl) . dr 
that converges ucp to 

([A,A](t)(V ® J»*)[N,N] x (i)(&* <E)k*)) 1/2 = 0. 

Step 2: 



(42) 
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We denote with V the linear combinations of elements of the form h* ® k* 
for h* € xo an d k € Hi. We remark that T> is dense in v. From the convergence 
found in Step 1, it follows that, for every (f> £ T>, ucp we have 

T e (0) ^ 0. 

Step 3: 

We consider a generic G By Lemma |2"T41 for f £ [s,T] it follows 
™ (t )| < ri(A(r + e)-A(0)^(N(. + £ )-N(,))^ ^ 



1 



= H„- / |(N(r + e)-N(r))| Jfi |(A(r + e)-A(r))| x . dr 

^ J S 

< \4>\u (j J |(N(r + e) - N(r))| 2 ffi dr ~ jf |(A(r + e) - A(r))g. dr 



1 



|0| J - / |(N(r + e)-N(r))|^ dr 



x - / |(A(r + e) - A(r))®^| x , dr ) . (43) 



To prove that [A, N], y =0 we check the corresponding conditions HI and H2 of 
the Definition 14.41 By Lemma 14.161 we know that N admits a global quadratic 
variation i.e. a (Hi (g> i?i)*-quadratic variation. By condition HI of the Def- 
inition 14.41 related to (Hi ® iJi)*-quadratic variation, for any sequence (e„) 
converging to zero, there is a subsequence (e Uk ) such that the sequence T e '**; (0) 
is bounded for any in the C[s, T] metric a.s. Moreover the P-null set does not 
depend on $. This in particular shows the condition HI of the ^-covariation. 
By Banach-Steinhaus for F-spaces (Theorem 17, Chapter II in [20] ) it follows 

that T e (0) > ucp for all € v and so condition H2 and the final result 
follows. □ 

Corollary 4.30. Assume that the hypotheses of Proposition ^. 29\ are satisfied. 
If X is a x-Dirichlet process then we have the following. 

(i) X is a v-weak-Dirichlet process. 

(ii) X is a x~weak Dirichlet process. 

(Hi) X is a x~ finite-quadratic-variation process. 

Proof, (i) follows by Proposition 14.291 

As far as (ii) is concerned, let X = M+A be a x-Dirichlet process decomposition, 
where and M be a local martingale. Setting Hi = H, then x is included in v, 
so Proposition 14. 291 implies that A is a x-orthogonal process and so (ii) follows. 
We prove now (iii). By Lemma T4. 161 and Remark 14. 101 M admits a %-quadratic 
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variation. By the bilinearity of the ^-covariation, it is enough to show that 
[M, A] x = 0. This follows from item (ii). □ 

Proposition 4.31. Let B\ and B2 two Banach spaces and x a Chi- sub space of 
(Bl<S>7r-B2)*. Let X and Y be two stochastic processes with values respectively in 
B\ and Bi admitting a \~ covariation. Let G be a continuous measurable process 
G : [s, T] x Q — > K, where K, is a closed separable subspace of x- Then for every 

te[s,T] 

1 x (G(-,r), [X, Y] e (-,r)} x . dr — + J x (G(;r),d^Y](;r)) x , (44) 
in probability. 

Proof. See [17] Proposition 3.7. □ 

We state below the most important result related to the stochastic calcu- 
lus part of the paper. It generalizes the finite dimensional result contained in 
[33] Theorem 4.14. The definition of real weak Dirichlet process is recalled in 
Definition 11.11 

Theorem 4.32. Let be a Banach subspace continuously embedded in H* . 
Define v := v^®^M. and \ '■= ^o^-k^q- Let F: [s,T] x H — > M be a C 0,1 -function 
with (t, x) n> d x F(t, x) continuous from [s, T] x H to v . Let X(t) = M(£)+A(£) 
for t G [s,T] be an v -weak- Dirichlet process with finite \-Quadratic variation. 
Then Y(t) := F(t,H(t)) is a (real) weak Dirichlet process with local martingale 
part 

R(t)=F(s,X(s))+ f (d x F(r,X(r)), dM(r)> . 

J s 

Remark 4.33. Indeed the condition X having a x-quadratic variation may be 
replaced with the weaker condition X and M having a z^o^R- covariation for 
any real local martingale M . 

Proof of Theorem \4-32\ By definition X can be written as the sum of a contin- 
uous local martingale M and a i/-martingale-orthogonal process A. 

Let N be a real- valued local martingale. Taking into account Lemma H. 191 
and that the covariation of two real local martingales defined in ([1]), coincide 
with the classical covariation, it is enough to prove that 

[F(;X(-)),N](t)= [ (d x F(r,X(r)), d[M, iV] ci (r)) , for all t G [s, T] . 
Let t G [s, T]. We evaluate the e-approximation of the covariation, i.e. 



(F(r + e, X(r + e)) - F(r, X(r))) (N(r + e) - N(r)) dr. 



It equals 

h(t,e)+I 2 (t,e) 
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where 



h (t, e) = [ (F(r + e, X(r + e)) - F(r + e, X(r))) i^Z+ll N W d r 



and 



h(t, e) = f (F(r + e, X(r)) - F(r, X(r))) ^ + f) N{r)) dr. 



We prove now that 

h(t, e) m> J* (&F(r, X(r)), d[M, iV] cZ (r)) (45) 
in probability; in fact 

Ii(t,e) = Ju(t,e) + Ji 2 (*,c) 

where 

1 

hi(t,e):= / -(flt e F(r,X(r)),X(r + e)-X(r)>(JV(r + e)-JV(r))dr, 
*ia(*, e) := / f - (d x F(r + e, aX(r) + (1 - a)X(r + e)) - d x F(r, X(r)), 



c 



X(r + e) - X(r)> (N(r + e) - N{r)) dr da. 



Now we apply Proposition g3T] with B 1 = H, B 2 = K, X = M, Y = N, \ = v 
so that ^ 

I n (t,e)^J ^9 x F(r,X(r)),dix7iV](r))^. (46) 

Recalling that X = M + A, we remark that [X, N] v exists and the v* -valued 
process [X, iV] equals 

since A is a ^-martingale orthogonal process. Taking into account the formalism 
of Proposition 14. 141 Remark ITOil and Proposition 14. 201 if $ e H = H*, we have 

Consequently, it is not difficult to show that the right-hand side of (|46|) gives 

(d x F(r,X(r)), d[M, Nf(r)). 
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For a fixed u £ f2 we consider the function d x F restricted to [s,T] x K 
where K is the (compact) subset of H obtained as convex hull of {aX(ri) + (1 — 
a)X(r 2 ) : ri,r 2 <E [s,T]}. d x F restricted to [s,T] x K is uniformly continuous 
with values in vq. As a result, w-a.s. 

\h2(t,e)\< [ S[d x F l[s , T]xK ;e+ sup |X(r) - X(t)\ u * ] 

Js V T' — 1 1 < e / 

x |X(r + e) -X(r)L*-\N(r + e) - N(r)\dr (47) 
e 

where, for a uniformly continuous function g : [s,T] x H — » ^o, (5(5; e) is the 
modulus of continuity <5(g;e) := sup| s _ t | <e — g{t)\ VQ . In previous formula 
we have identified H with H** so that |a;|jj < \x\ v *,Mx e H. So (gTJ) is lower 
than 



<5[d x F l[s , T]yK ;e+ sup |X(s) - X(t)|„. 

y |s-*|<e / 

T T \ 1/2 

V(' + e) - iV(r)| 2 dr / l|(X(r + e) - X(r))| 2 dr 



= <H & J F| [s . T]xK ;e+ sup |X(s)-X(t)|„ . 

V |a-*l<£ / 

j. j. \ !/ 2 

x j / ^\N{r + e)-N(r)\ 2 drj^ ~|(X(r + e) - X(r)) ® 2 | x . dr J , (48) 

where we have used Lemma 12^41 This of course converges to zero since X [resp. 
N] is a ^-finite quadratic variation process [resp. a real finite quadratic variation 
process] and X is also continuous as a ^Q-valued process. 

To conclude the proof of the proposition we only need to show that 

hit, e) — -— > 0. This is relatively simple since 

1 f* 

h(t, e) = - T(u, e) dN(u) + R(t, e) 

^ J s 

where R(t, e) is a boundary term s.t. R(t, e) £ ^°> ucp and 

r(u,e) = - / \F(r + e,X(r)) -F(r,X(r))| dr. 

Since 

T 

(r(?i,e)) 2 d[7V](u) -> 

in probability, Problem 2.27, chapter 3 of [34J implies that /2O, e) — >• ucp. The 
result finally follows. □ 
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5 The case of stochastic PDEs 



This section concerns applications of the stochastic calculus via regularization 
to mild solutions of stochastic partial differential equations (SPDEs). 

Assume, as in Subsection l3.1l that H and U are real separable Hilbert spaces, 
Q e C{U), U := Q 1/2 {U). Assume that W Q = {W Q (t) : t < s < T} is 
an [/-valued &\-Q- Wiener process (with Wq(s) = 0, P a.s.) and denote with 
£2(Uo,H) the Hilbert space of the Hilbert-Schmidt operators from Uo to H. 
We adopt the conventions of the mentioned subsection. 

We denote with A: D(A) C H H the generator of the Co-semigroup e tA 
(for t > 0) on H. The reader may consult for instance |4j Part II, Chapter 1 
for basic properties of Co-semigroups. A* denotes the adjoint of A, D(A) and 
D(A*) are Banach (even Hilbert) spaces when endowed with the graph norm. 

Denote with C(H) the space of the continuous functions from H to R, with 
C 1 * 2 ^, T] x H) the set of all the C^-Fresh differentiable functions from [0, T] x 
H to M and with C(H; D(A*)) the set of all the continuous functions from H 
to D(A*), endowed with the graph norm. 

Let & be a predictable process with values in H and a be a predictable 
process with values in £2(^0, H) such that 

l^)l + K*)llL(c/ ,*) d *<+ 00 = 1 - ( 49 ) 

We introduce the process 

X(t) - e^ A x + J e {t ' r)A b{r) dr + J e {t ~ r ^ A a{r) dW Q (r). (50) 

A mild solution to an SPDE of type ^ is a particular case as ([50)1 . We define 

Y(t) := X(t) - J b(r) dr - J a(r) dW Q (r) - x. (51) 

Lemma 5.1. Let b be a predictable process with values in H and a a predictable 
process with values in £2(Uo,H) such that is satisfied. Let X(£) be defined 
by [Sty) and Y defined by If z G D(A*) we have 

(Y(t),z) = j (X(r),A*z) dr. (52) 

Proof. See [45] Theorem 12. □ 

We want now to prove that Y has zero-x-quadratic variation for a suitable 
space x- We will see that the space 

X ■= D(A*)<g> n D(A*). (53) 

does the job. We set Do := D(A*) which is clearly continuously embedded into 
H*. 

By Lemma |4~T| x is a Chi-subspace of (H^^H)* . 
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Proposition 5.2. The process Y has zero \- quadratic variation. 



Proof. Observe that, thank to Lemma 3.18 in [T3] it will be enough to show 
that 

1(e) ■=- f I (Y(r + e) - Y(r)) ® 2 | r dr 0, in probability. 

e J S 

In fact, identifying with B(i?q, Dq]M.), we get 



sup |((Y(r + e)- Y(r)),0) ((Y(r + e) - Y(r)), V)| dr 

S |0|^- o , |-0U- O <1 



1 

< - 

e 



sup 



r+e 



((X(0,A» d£ 



r+e 



<(X(0,AV) d£ 



dr 
(54) 



where we have used Lemma UTTl This is smaller than 



r+e 



|x(0|d£ 



dr < e sup |X(0| 2 
fe[s,T] 



which converges to zero almost surely. 



□ 



Corollary 5.3. The process X is a x~Dirichlet process. Moreover it is also a x 
finite quadratic variation process and a Do®^M.-weak-Dvrichlet process. 

Proof. For t E [s, T], we have X(t) = M(i) + A(t), where 



M(i) = x + J a(r)dW Q (r) 
A(i) = V(f) + Y{t) 



b(r)dr. 



V(t) 



M is a local martingale by Proposition 13.51 (i) and V is a bounded variation 
process. By Proposition 14. 131 and Remark 14.101 we get 

[V,Vfe = [V,Yk = [Y,Vfe = 0. 

By Proposition 15 . 21 and the bilinearity of the x-covariation, it yields that A has 
a zero %-quadratic variation and so X is a x-Dirichlet process. The second part 
of the statement is a consequence of Corollary 14.301 □ 

The theorem below generalizes for some aspects the Ito formula of [14], i.e. 
their Theorem 5.2, to the case when the second derivatives do not necessarily 
belong to the Chi-subspace %• 
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Theorem 5.4. Let X be a x-finite quadratic variation H -valued process. Let 
F : [s,T] x H — > R of class C 1 ' 2 such that (t, x) — > d x F(t, x) is continuous from 
[s,T] x H to D(A*). Suppose moreover the following. 

(i) There exists a (cadlag) bounded variation process C : [s,T]xf2 — > (if (§)„■_/?) 
such that, for all t in [s, T] and (f> 6 x, 

c(*,-)(0) = [x,x] x (0)(t > o 

(ii) For every continuous function T: [s,T] x H — > D(A*) the integral 

(r(r,X(r)),d-X(r)) (55) 
exists. 

Then 

F(t, X(i)) = F(s, X(a)) + J (d r F(r, X(r)), d"X(r)) 

+ \ f (h^hy ( d ** F (r, X(r)), dC( S )) H ^ H + |' d r F(r, X(r)) dr. (56) 

Before the proof of the theorem we make some comments. 

Remark 5.5. A consequence of assumption (i) of Theorem \5.4\ is the existence 
of a P-null set O such that, for every t £ [s, T], ui O, 

S^(Mt,w)=C(t,w)(0) 

for every <j) £ D{A*)®^D{A*). In other words the x~Quadratic variation of X 
coincides with C . 

Remark 5.6. The conditions (i) and (ii) of Theorem \ 5.4\ are verified if for 
instance X = M + V + §, where M is a local martingale, V is an H-valued 
bounded variation process, and § is a process verifying 

{§, h) (t) = j (Z(r),A*h) dr for all h g D{A*) 

for some Bochner measurable process Z with |Z(r)| 2 dr < +oo a.s. 

Indeed, by Lemma \4-lb\ M admits a global quadratic quadratic variation 
which can be identified with [M,M] c( . 

On the other hand A = V + § has a zero x-quadratic variation, by Propo- 
sition \4-13\ and the bilinearity character of the x-covariation. X is therefore 
a x~Dirichlet process. By Corollary \4-30\ and again the bilinearity of the x~ 
covariation, we obtain that X has a finite x~ quadratic variation. Taking also 

into account Lemma \4~l6\ and Remark \4~Tb\ we get [X, XL ($)(•) = ([M,M] ci ,$) 
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Consequently, we can set C = [M, M] c ' and condition (i) is verified. 
To prove (ii) consider a continuous function Y: [s,T] X H — > D(A*). The 
integral of (T(r, X(r))) w.r.t. the semimartingale M + V where M(i) = x + 
J er(r) dWQ (r) exists and equals the classical ltd integral, by Proposition Iff. 61 
and Provosition I ff. 81 Therefore, we only have to prove that 

(r(r,X(r)),d-S(r)), te[s,T] 

exists. For every t £ [s,T] the e- approximation of such an integral gives, up to 
a remainder boundary term G{e,t) which converges ucp to zero, 



1 '* 



r(r,X(r)),S(r + e)-S(r)) dr 

Z(«),A*r(r,X(r))> dudr 



I rt rr+e 



e 

1 



(Z(u), A*T(r,X(r))} dr du ^> / (Z(u), AT(u, X(u))) du 

(57) 



s J u — e 



m probability by classical Lebesgue integration theory. The right-hand side of 
i57\) has obviously a continuous modification so (|55|) exists by definition and 
condition (ii) is fulfilled. 
In particular we have proved that 



t r t 



(r(r,X(r)),d-X(r)) = / <r(r,X(r)), dM(r)> + / (T(r,X(r)), dV(r)> 



t 

(Z(u),A*r(u,X(u))) du 

J s 

Proof of Theorem \5.4\ 
Step 1: 

Let {e*}i € N be an orthonormal basis of H* made of elements of D(A*) C H*. 
For N > 1 we denote by P^ : JJ — > H the orthogonal projection on the span of 
the vectors {ei, .., ejy}. Poo '■ H H will simply denote the identity. 
We define ify : if ->• R as Fjv(^) := F(P N (x)). We have 

fl s Fjv(a;) = P N d x F(P N X(x)) 

and 

d 2 xx F N (x) = (Pv ® P N )d 2 xx F(P N X(x)) 
where the last expression has to be understood as 

(H®„H)* (9 2 xx F N {x), hi ® h 2 ) (H ^ H) 

(d 2 xx F(P N (x)), (P N (hi)) ® (PN(h 2 ))) (H ^ H) (58) 
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for all h\,h,2 £ H. ^^(i) is an element of (H^^H)* but it belongs to 
(D(A*)(g) 7r D(A*)) as well; indeed it can be written as 



N 



and e* ® e* are in fact elements of (D(A*)®„D(A*)). 

So one can apply the Ito formula proved in |14| . Theorem 5.2, and with the 
help of Assumption (i) , we find 

F N (t,K{t)) = F N (s,X(s)) + f (d x F N (r,X(r)), d"X(r)) 



+ 5/ (C^(r,X(r)),dC( S ))+ / 5 r F A r(r,X(r))dr. (59) 



Step 2: 

We consider, for fixed e > 0, the map 

' T e : C([s, T] x H; D(A*)) -> L°(fi) 

where C([s,T] x H; D(A*)) is equipped with the uniform convergence on com- 
pact sets and L°(f2) (the set of the real random variables) with the convergence 
in probability. Assumption (ii) implies that lim e _>.o T £ G exists for every G. By 
Banach-Steinhaus for F-spaces (see Theorem 17, Chapter II in [20] ) it follows 
that the map 

( C([s,T] x H;D(A*)) -> L°(Q) 
G^ f (G(r,X(r)), d~X(r)) 

J s 

is linear and continuous. 



Step 3: 

If K C H is a compact set then the set 

P(K) := {P N (y) ■ V G K, N e N U +00} 

is compact as well. Indeed, consider {Pn 1 (j/i)}z>i be a sequence in P(K). We 
look for a subsequence convergence to an element of P{K). 

Since K is compact we can assume, without restriction of generality, that yi 
converges, for I — ¥ +00, to some y 6 K. If {iV;} assumes only a finite number of 
values then (passing if necessary to a subsequence) Ni = N for some TV G NU+oo 

and then P/v ( (yi) '^ + °°> P^(j/). Otherwise we can assume (passing if necessary 
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to a subsequence) that Ni '~ s ' +00 > +00 and then it is not difficult to prove that 

PNi(yi) y, which belongs to P(K) since y = PooU- 

In particular, being d x F continuous, 

V := {d x F{P N {x)) : x £ K, N e N U {+00}} 

is compact in D(A*). Since the sequence of maps {Pn} is uniformly continuous 
it follows that 

sup I (JW -/)(*) I ^^>0. (60) 

Step 4- 

We show now that 



JV- 



lim / (d x F N (r,X(r)), <TX(r)) = / (d x F(r,X(r)), d~X(r)) . (61) 



holds in probability for every t £ [s,T]. 

Let K be a compact subset of H. In fact 



sup \d x F(P N x) - d x F(x)\ 0, 

since d x F is continuous. On the other hand 

sup \(P N - I)(d x F(P N x))\ 0, 

because of (|60|) . Consequently 

0*** 9 X F (62) 
uniformly on each compact, with values in H. This yields that w-a.s. 

d^(r,X(r)) ->^F(r,X(r)) 
uniformly on each compact. By step 2, then (fUTj) follows. 

Step 5: 
Finally, we prove that 

ifc 5 / <^^( r ' X ( r ))' dC ( s )) = ^ / <C^(^X(r)), dC(*)> . (63) 



For a fixed u 6 O we define K(lu) the compact set as 
K(u) := {X(t)(w) : t £ [s,T]}. 
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We write 



(d 2 xx F N (r,X(x)) - d 2 xx F(r,X(x)), dC(r)) 
< sup \\d 2 xx F N (t,y)-d 2 xx F(t,y)\\ 



yeK(w) 

te[s,T] 



d|C(r)|(w). (64) 



Using arguments similar to those used in proving (|52^) one can see that 



®lx F N N ^ oc ) d xx F 



uniformly on each compact. Consequently 

sup \{d 2 xx F N - dl x F)(r,TL{r))\, m H) » 

re[s,T] 

Since C has bounded variation, finally ([63)) holds. 



N- 



Step 6: 

Since Fn [resp. d r F^\ converges uniformly on each compact to F [resp. 
d r F], when N — > oo, then 



d r F N (r,X(r))dr 



d r F(r,X{r))dr. 



Taking the limit when N — > oo in (JST))) finally provides ([SB]). 



□ 



Next result can be considered a Ito formula for mild type processes, essentially 
coming out from mild solutions of SPDEs. An interesting contribution in this 
direction, but in a different spirit appears in [9J. 

Corollary 5.7. Assume that b is a predictable process with values in H and 
a is a predictable process with values in £2(1/0, H) satisfying Define X 

as in 150)) . Let x be an element of H . Assume that f G C l,2 (H) with d x f G 
C(H,D(A*)). Then 

f(t, X(t)) = f(s, x) + f d s f(r, X(r)) dr 



+ / <A*3 x /(r,X(r)),X(r))dr+ / (9 x /(r,X(r)),6(r)} dr 



7r 



o{r)Q^ 2 ) (a{r)Q l ' 2 y d 2 xx f{r,X(r)) 



+ / (d x f(r,X(r)),a(r)dW Q (r)) 



dr 



a.s., (65) 
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Remark 5.8. We remark that in (|65p . the partial derivative d xx f{r,x) for any 
r G [s, T] and x G H stands in fact for its associated linear bounded operator in 
the sense of ©■ From now on we will make this natural identification. 

Proof. It is a consequence of Theorem 15.41 taking into account Remark 15.61 we 
have M(t) =x + f s a(r) dW Q (r), t e [0, T], V(i) - J s * 6(r)dr, S = Y with Z(r) = 
X(r). According to that Remark, in Theorem EH] we set C = [M, M] cZ . We also 
use the chain rule for Ito's integrals in Hilbert spaces, see the considerations 
before Proposition 13.51 together with Lemma [4.181 The fourth integral in the 
right-hand side of (|65|) appears from the second integral in (|56|) together with 
Proposition 12.61 and again Lemma 14.181 □ 

6 The optimal control problem 

In this section we illustrate the utility of the tools of stochastic calculus via reg- 
ularization in the study of optimal control problems driven by SPDEs. We will 
prove a decomposition result for the strong solutions of the Hamilton-Jacobi- 
Bellman equation related to the optimal control problem and we use that de- 
composition to derive a verification theorem. 



U, U , Wq = {W Q (t) :t<s<T}, £ 2 (U ,H) and A: D(A) CH^H were 



defined as in Section [5] 

6.1 The setting of the problem 

We consider a Polish space A and we formulate the following standard assump- 
tion that will ensure existence and uniqueness for the solution of the state equa- 



Hypothesis 6.1. b: [0, T] x H x A — > H is a continuous function and satisfies, 
for some C > 0, 



for all x,y G H, s G [0,T], a G A. a: [0, T] x H — >• £2{Uq,H) is continuous 
and, for some C > 0, 

\W(s,x) ~ a{s,y)\\c 2 (u„,H) ^ c \ x - vl 
\W(s,x)\\c 2(UaM) < C(l + \x\) 

for all x,y G H , s G [0, T] . 

Let us fix for the moment a predictable process a — a(-) : [s,T] x — > A, 
where the dot refers to the time variable, a will indicate in the sequel an 
admissible control in a sense to be specified. 

We consider the state equation 



tion. 



\b(s, x, a) — b(s, y,a)\ < C\x — y 
\b(s,x,a)\ < C(l + |x|) 




dX(t) = (AX(t) +b(t,X(t),a(t))) dt + <j(t,X(t))dW Q (t) 



(66) 
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The solution of is understood in the mild sense, so an H- valued adapted 
strongly measurable process X(-) is a solution if 



|X(r)| + \b(r,X(r)Mr))\ + \W(r,X(r))\\c a [u ,H) dr < 



-oo 



and 



X(t) = e {t - s)A x + / e^- r)A b(r,X(r),a(r))dr + / e {t - r)A a{r, X(r)) dW Q (r) 

(67) 

P-a.s. for every t € [s, T], 

Thanks to Theorem 3.3 of [28J .given Hypothesis 16.11 there exists a unique 
solution X(-; s, x, o(-)) of (|66[). which admits a continuous modification. So for 
us X can always be considered as a continuous process. 

Setting b := &(■, X(-; s, x, a(-)), a(-)), cr := er(-,X(-; s, x, a(-))) then X fulfills 
(fl9")) and it is of type ([50)1 . The following corollary is just a particular case of 
Corollary 15. 71 which is reformulated here for the reader convenience. 

Corollary 6.2. Assume that b and a satisfy the Hvvothesis \6.1\ Let a : [s,T] x 
SI — > A be predictable and x G H. Let X(-) denote X(-; s, x, «(■)). Assume that 
/ G C*^ 2 (iJ) tmft fl x / G C(H,D(A*)).Then 



f(t,X(t)) = f( S ,x)+ / r /(r,X(r))dr 



(A*0 B /(r,X(r)),X(r)) dr 



(^/(r,X(r)),6(r,X(r),a(r))) dr 



Tr 



(a(r, X(r))Q 1 / 2 ) (a(r, X(r))Q 1 / 2 ) * d 2 xx f(r, X(r)) 



dr 



+ ^ (d x f(r,X(r)),a(r,X(r))dW Q (r)) . F-a.s. (68) 

Let /: [0, T] x H x A — > R be a measurable function and g: _ff — > Ma 
continuous function. I is called the running cost and g the terminal cost. 
We introduce now the class U s of admissible controls. It is constituted by 
a : [s,T] x Jl — > A such that for uj a.s. (r, cj) H > l(r,X(r,s,x,a(-)),a(r)) + 
gr(X(T, s, x, a(-))) is dr ® dP- is quasi-integrable. This means that, either its 
positive or negative part are integrable. 

We want to determine a minimum over all a(-) Gi/ S , of the cost functional 



J(s,x;a(-)) 



i(r, X(r; s, x, a(-)), a(r)) dr + g(X(T; s, x, a(-))) 



(69) 



The value function of this problem is defined as 



V(s,x) — inf J(s, x; a(-))- 



(70) 
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Definition 6.3. Ifa*{) G £4 minimizes h69\) among the controls inU s , i.e. if 
J (s, x; <!*(•)) — V(s,x), we say that the control a* (•) is optimal at (s, x). In this 
case the pair (a*(-),X*(-)), where X*(-) := X(-; s, x, a* (•)), is called an optimal 
couple (or optimal pair) at (s, x). 

6.2 The HJB equation 

The HJB equation associated to the minimization problem above is 

d s v + {A*d x v, x) + \Tr [ a(s, x)a* (s, x)d xx v] 

+ inf aeA | (d x v,b(s,x,a)) +l(s,x,a)^ = 0, (71) 
v(T,x) = g(x). 

In the above equation d x v [resp. d xx v] is the [second] Frechet derivatives of v 
w.r.t. the x variable; it is identified with elements of H [resp. with a symmetric 
bounded operator on H\. d s v is the derivative w.r.t. the time variable. For 
(t, x,p, a) S [0, T] x H x H x A, the term 

Fcvit.x.p^) := (p,b(t,x,a)) +l(t,x,a) (72) 

is called the current value Hamiltonian of the system and its infimum over a G A 

F(t, x,p) := inf {{p, b(t, x, a)) + l(t, x, a)} (73) 

is called the Hamiltonian. Using this notation the HJB equation (|7ip can be 
rewritten as 

f d s v + (A*d x v, x) + \Tr [a(s, x)cr* (s, x)d 2 x v] + F(s, x, d x v) = 0, 
\ v(T,x) = g(x). 

Hypothesis 6.4. The value function is always finite and the Hamiltonian 
F(t,x,p) is well-defined and finite for all (t,x,p) £ [0,T] x H x H. Moreover it 
is supposed to be continuous. 

We introduce the operator Jzfo on C([0, T] x H) defined as 
D(J%) := W e C 1,2 ([0,T] x JT) : 9^ e C([0,T] x 

jSfo(y)(s,a:) := d s (p{s,x) 

+ (A* d x ip(s , x) , x) + ^Tr [<r(s, x)cr*(s, x)d xx (p(s, x)] . 

(75) 

The HJB equation (|74l) can be rewritten as 



J?o(v)(s, x) + F(s, x, d x v(s, x)) = 
v{T,x) = g[x). 
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6.3 Strict and strong solutions 

For some h £ C([0,T] x H) and g £ C(H) we consider the following Cauchy 
problem 

| & (v)(s,x) = h(s,x) ^ 
\ v(T,x) = g(x). 

Definition 6.5. We say that v £ C([0,T] x H) is a strict solution of 175)) if 
v £ D(J/Cq) and d 761) is satisfied. 

Definition 6.6. Given h £ C([0,T] x H) and g £ C{H) we say that v £ 
C 0,x ([0,T] x H) with d x v £ C([0,T] x H; D(A*)) is a strong solution of */ 
there exist three sequences: {v n } C D(JZ'q), {h n } C C([0,T] x i?) awd {^n} C 
C (i? ) fulfilling the following. 



(i) For any n £ N, v n is a strict solution of the problem 

j J2b(v n )(s,x) = h n (s,x) 
\ v n (T,x) = g n (x). 

(ii) The following convergences hold: 



(77) 



v n ->v in C([0,T] x H) 
h n -)• h in C([0,T] x H) 
g„ -> g in C(H) 

6.4 Decomposition for solutions of the HJB equation 

Theorem 6.7. Consider h £ C([0, T]xH) and g £ C(H). Assume that Hypoth- 
esis\jn\is satisfied. Suppose that v £ C° A {[0,T] x H) with d x v £ C{H;D(A*)) 
is a strong solution of 1176]) . Let X(-) := X(-; t, x, <x(-)) be the solution of id 6]) 
starting at time s at some x £ H and driven by some control a(-) £ U s . Assume 
that b is of the form 

b(t, x, a) = b g (t, x, a) + bi(t, x, a) (78) 
where b g and 6j satisfy the following conditions. 

(i) cr(t,X(t)) b g (t,'K(t),a(t)) is bounded (being cr(i,X(i)) _1 the pseudo- 
inverse of a); 

(ii) bi satisfies 



n— >oo 



lim / (d x v n (r, X(r)) - d x v(r, X(r)),6j(r, X(r),a(r))) dr = ucp. 

(79) 
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Then 

v(t,X(t)) -v(s,X(s)) = v(t,X(t)) -v(s,x) = [ h{r,X(r))dr 

J S 

+ f (d x v(r,X(r)),b(r,X(r),a(r))) dr 

J s 

+ (d x v(r,X(r)),a{r,X{r))dW Q (r)} . (80) 

Example 6.8. Hypothesis (i) and (ii) of Theorem 16. 71 are satisfied if the ap- 
proximating sequence v n converges to v in a stronger way. For example if v 
is a strong solution of the HJB in the sense of Definition 1 6'. 61 and, moreover, 
d x v n converges to d x v in C([0,T] x H), then the convergence in point (ii) can 
be easily checked. The convergence of the spatial partial derivative is the typical 
assumption required in the standard strong solutions literature. 

Example 6.9. The assumptions of Theorem 16. 71 are fulfilled if the following 
assumption is satisfied. 

a(t,X(t))~ 1 b(t,X(t),a(tj) is bounded 

for all choice of admissible controls a(-). In this case we apply Theorem 1 6. 71 with 
bi = and b = b g . 

Proof of Theorem 16. 71 We denote by v n the sequence of smooth solutions of 
the approximating problems prescribed by Definition 16.61 which converges to v. 
Thanks to Corollary |6.21 every v n verifies, 

v n (t,X(t)) = v n (s,x) + / d r v n (r, X(r))dr 



+ (A*d x v n (r,X(r)),X(r)) dr+ / (d x v n {r, X(r)), b(r, X(r), a(r))} dr 



1 '* 



Tr 



dr 



(a(r,X(r))Q 1 / 2 ) (a(r,X(r))g 1 / 2 ) 8 2 xx v n (r, X(r)) 
+ J (d x v n (r,X(r)),a(r,X(r))dW Q (r)). P - a.s. (81) 
Using Girsanov's Theorem (see [10 Theorem 10.14) we can observe that 
~W Q (t)+ /' t f 7(r,X(r))- 1 6 9 (r,X(r), a (r))dr 

J s 

is a Q- Wiener process w.r.t. a probability Q equivalent to P. We can rewrite 
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IHH) as 

v n (t, X(i)) = v n (s,x) + / 9 r u„(r,X(r)) dr 



+ / (A*d x v n (r,X(r))Mr)) dr+ (d x v n {r, X(r)), &,(r, X(r), o(r))) dr 



Tr 



dr 



V(r,X(r))Q 1 / 2 j ( (T(rjX (r))g 1 /2j ^( r , X (r)) 
+ / (d^ n (r,X(r)),a(r,X(r))d/3 Q (r)). P - a.s. (82) 
Since v n is a strict solution of ([77]), the expression above gives 

v n (t,X(t)) = v n (s, x) + J h n (r,X(r)) dr 

+ f (0,« n (r,X(r)),fc(r,X(r),a(r))) dr 

«/ S 

+ f (d x v n (r,X(r)),a(r,X(r))dp Q (r)) . (83) 



Since we wish to take the limit for n — > oc, we define 

M n (t) :=v n {t,X{t))-v n {s,x)- J h n (r,X(r))dr 

t 

(d x v n {r,X{r)),bi(r,X(r),a(r))) dr. (84) 

{M n }„ e N is a sequence of real Q- local martingales converging ucp, thanks to 
the definition of strong solution and Hypothesis (f79|) . to 

M(t) := v(t, X(t)) - v(s, x) - J h(r, X(r)) dr 

t 

(d x v(r,X(r)),bi(r,X(r),a(r))) dr. (85) 

Since the space of real continuous local martingales equipped with the ucp 
topology is closed (see e.g. Proposition 4.4 of [33]) then M is a continuous 
Q-local martingale. 

We have now gathered all the ingredients to conclude the proof. As in Section 
[S] we set P = D(A*), v = v ^> n R,x = ^o^tt^o- 

Corollary 15.31 ensures that X(-) is a i^-weak Dirichlet process with finite 
quadratic variation with decomposition M + A where M is the local martingale 
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(with respect to P) defined by M(i) = x + f s a(r, X(r)) dW Q (r) and A is a 
^-martingale-orthogonal process. Now 

X(t) = M(t) + V(t) + A(i), f e [0, T], 

where M(t) = x + f s a(r, X(r)) d/3 Q (r) and V(i) = - f s b g (r,X(r), a(r))dr, t E 
[0,T] is a bounded variation process. So by Proposition 13.51 (i), M is a Q- 
local martingale and by Proposition ^. 251 1.. V is a Q — ^-martingale orthogonal 
process. By Remark 14.241 V + A is a Q — ^-martingale orthogonal process and 
X is a i^-weak Dirichlet process with local martingale part M , with respect to 
Q. Still under Q, Theorem l4.32l ensures that the process v(-, X(-)) is a real weak 
Dirichlet process whose local martingale part being equal to 



N(t) = J (d x v(r,X(r)),a(r,X(r))d/3 Q (r)) 
On the other hand, with respect to Q, (|55|) implies that 



v(s,x)+ / /i(r,X(r))dr 



+ / {d x v(r,X(r))Mr,*(r),a(r))) ^ 



N(t). (86) 



is a decomposition of i?(-,X(-)) as Q- semimartingale, which is also in particular, 
a Q-weak Dirichlet process. By Proposition 11.21 such a decomposition is unique 
and so 



M(i) = 2V(i) = / (d x v(r, X(r)), <r(r, X(r)) d/3 Q (r)) 



(6S e i;(r,X(r)),6 fl (r,X(r),a(r))dr> 



+ 



(5^(r, X(r)), <r(r, X(r)) dW Q (r)> (87) 



This concludes the proof of Theorem 16. 71 



□ 



6.5 Verification Theorem 

Theorem 6.10. Assume that Hypotheses \ 6.1\ and \ 6.4\ are satisfied. Let v € 
C OA ([0,T] x H) with d x v G C(H;D(A*)) be a strong solution of $7Tj). Assume 
that for all initial data {s,x) G [0,T] x H and every control a(-) G U s b can be 
written as b(t, x, a) = b g (t, x, a) + bi(t, x, a) with bi and b g satisfying hypotheses 
(i) and (ii) of Theorem \6. r A Let v such that d x v has most polynomial growth in 
the x variable. Then 



(i) v < V on [0,T] x H. 
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(ii) Suppose that, for some s £ [0,T), there exists a predictable process a(-) — 
a*(-) £lA s such that, denoting X(-;s,x, a* (•)) simply byX*(-), we have 

F (t, X* (t) , d x v (t, X* (t))) = F cv (t, X* (t) , d x v (t, X* (t)) ; a* (t)) , (88) 

alt ® dP a.e. Then a*(-) is optimal at (s, x); moreover v (s, a;) = V (s, x). 

Proof. We choose a control a(-) G £4 and call X the related trajectory. Thanks 
to Theorem 16 . 71 we can write 

g(X(T)) = v(T, X(T)) = «(«, x) - / F(r, X(r), d x v(r, X(r))) dr 



f / (fl x «(r,X(r)),6(r,X(r),o(r))> dr 

+ / (9 x <r,X(r)),a(r,X(r))dW Q (r)) 



Since both sides of (|89[) are a. s. finite, we can add f l(r, X(r), a(r)) dr to 
them, obtaining 

<?(X(T)) + | l(r, X(r), a(r)) dr = w(s, as) 

+ J (-F(r, X(r), %«(r, X(r))) + F cv (r, X(r), 5 xU (r, X(r)))) dr 

+ / <cU(r,X(r)),a(r,X(r))dW Q (r)). (90) 

J S 

Observe now that, by definition of F and Fcv we know that 

-F(r, X(r),d x v(r, X(r))) + F cv (r, X(r),d x v(r, X(r))) 

is always positive. So its expectation always exists even if it could be +oo, 
but not -co on an event of positive probability. This shows a posteriori that 

l(r, X(r), a(r)) dr cannot be -co on a set of positive probability. 
By [TO] Theorem 7.4, all the momenta of sup re r s T i |X(r)| are finite. On the 
other hand, a is Lipschitz-continuous, v(s,x) is deterministic and, since d x v has 
polynomial growth, then 

(d s v(r,*(r)), (a(r, X(r))Q 1 / 2 ) (a(r, X^Q 1 / 2 ) * d x v(r, X(r))) dr. 
is finite. Consequently, by Proposition ^. 51 (v) 

(0 x w(r,X(r)),a(r,X(r))dWo(r)) 

is a true martingale vanishing at s. Consequently, its expectation is zero. 

So the expectation of the right-hand side of (j^U)) exists even if it could be +oo; 
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consequently the same holds for the left-hand side. 
By definition of J, we have 



J(s, x, a(-)) = E 



T 



ff(X(T))+ / l(r,X(r),a(r))dr 



v(s, x) 



T 



+ EJ ^- F(r,X(r),d x v{r,X(r))) + F cv {rMr),9 x v{r,X(r)),a(r))) dr. 

(91) 

So minimizing J(s,x, <z(-)) over a(-) is equivalent to minimize 



E 



( - F(r, X(r), d x v(r, X(r))) + F cv (r, X(r), fi^fr, X(r)), a(r))) dr. (92) 



As mentioned above, the integrand of such an expression is always nonnegative 
and then a lower bound for (|92p is 0. If conditions of point (ii) are satisfied 
such a bound is attained by the control a*(-), that in this way is proved to be 
optimal. 

Concerning the proof of (i), since the integrand in (|92|) is nonnegative, (|9ip 
gives 

J(s, x, a{-)) > v(s, x). 
Taking the inf over a(-) we get V(s, x) > v(s, x), which concludes the proof. □ 

Remark 6.11. 1. The first part of the proof does not make use that a belongs 
to U s , but only that r <-> 2(r,X(-, s,x,a(-)),a(-)) is a.s. strictly bigger then 
— oo. Under that only assumption, a(-) is forced to be admissible, i.e. to 
belong to IA S . 

2. Let v be a strong solution of HJB equation. Observe that the condition 
can be rewritten as 

a* (t) e arg min \f cv (t, X* (t) , d x v (t, X* (t)) ; a) 

aeA L 

Suppose that for any (t,y) G [O,? 1 ] x H, <p(t,y) = 

arg min aS A (Fcv {t, y, d x v(t, y); a) ) is measurable and single-valued. 
Suppose moreover that 

T 

l(r, X*(r), a* (r))dr > -oo a.s. (93) 

Suppose that the equation 

( dX(t) = (AX(t) +b(t,X(t),<f>(t,X(t)) dt + a(t,X(t))dW Q (t) 
\ X(s) = x. ^ 

admits a unique mild solution X*. Now (|93[) and Remark \6.11\ imvlv that 
a(-)* is admissible. Then X* is the optimal trajectory of the state variable 
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and a*(t) = (f>(t,'K*(t)),t £ [0,T] is the optimal control. The function <p is 
the optimal feedback of the system since it gives the optimal control as a 
function of the state. 

Remark 6.12. Observe that, using exactly the same arguments we used in this 
section one could treat the (slightly) more general case in which b has the form: 

bit, x, a) = bo(t, x) + b g (t, x, a) + bi(t, x, a). 

where b g and bi satisfy condition of Theorem 1 6. 71 and bo : [0, T] x H — i H is 
continuous. In this case the addendum bo can be included in the expression of 
Jzfo that becomes the following 

J D(J? b °):={tp€C l > 2 ([0,T]xH) : d x ip e C([0, T] x H; D(A*))} 

\ ^° (<p) := d s <p + (A*d x <p, x) + {d x ip, b (t, x)) + iTr [a(s, x)a* (s, x)d 2 xx y] . 

(95) 

Consequently in the definition of regular solution the operator Ji? Q ° appears in- 
stead Jz?o . 
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